Jul 08 16:07:10 devstack cinder-volume[75965]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 16:07:10 devstack cinder-volume[75965]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 16:07:10 devstack cinder-volume[75965]: we strongly recommend against using it for new projects. Jul 08 16:07:10 devstack cinder-volume[75965]: If you are already using Eventlet, we recommend migrating to a different Jul 08 16:07:10 devstack cinder-volume[75965]: framework. For more detail see Jul 08 16:07:10 devstack cinder-volume[75965]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 16:07:10 devstack cinder-volume[75965]: import eventlet # noqa Jul 08 16:07:13 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:07:13 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:07:13 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:07:14 devstack cinder-volume[75965]: INFO dbcounter [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Registered counter for database cinder Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG dbcounter [-] [75965] Writer thread running {{(pid=75965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:07:14 devstack cinder-volume[75965]: INFO cinder.rpc [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 16:07:14 devstack cinder-volume[75965]: INFO cinder.rpc [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:07:14 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Determined volume DB was empty at startup. Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG cinder.volume.manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75965) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 16:07:14 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 16:07:14 devstack cinder-volume[75965]: WARNING stevedore.named [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 16:07:14 devstack cinder-volume[75965]: WARNING castellan.key_manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:07:14 devstack cinder-volume[75965]: WARNING cinder.keymgr.conf_key_mgr [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG cinder.volume.drivers.lvm [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75965) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 16:07:14 devstack cinder-volume[75965]: DEBUG oslo_concurrency.processutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75965) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_concurrency.processutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] CMD "cinder-rtstool verify" returned: 0 in 0.453s {{(pid=75965) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:07:15 devstack cinder-volume[75965]: INFO cinder.rpc [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 16:07:15 devstack cinder-volume[75965]: INFO cinder.rpc [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 16:07:15 devstack cinder-volume[75965]: WARNING stevedore.named [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 16:07:15 devstack cinder-volume[75965]: WARNING castellan.key_manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:07:15 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:07:15 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Starting 1 workers Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Started child 76143 {{(pid=75965) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Full set of CONF: {{(pid=75965) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] ******************************************************************************** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Configuration options gathered from: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] ================================================================================ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] allow_availability_zone_fallback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] allow_compression_on_image_upload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] allowed_direct_url_schemes = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] api_rate_limit = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] auth_strategy = keystone {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] az_cache_duration = 3600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_host = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[76143]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_stats_polling_interval = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backup_api_class = cinder.backup.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backup_name_template = backup-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backup_use_same_host = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backup_use_temp_snapshot = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] chap_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_internal_tenant_project_id = 40f7f1820cf74301a3f3b2d98d5c981a {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_internal_tenant_user_id = db4f298ada6a4c02b7b1dcefe7ac787e {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cloned_volume_same_az = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cluster = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] compression_format = gzip {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] compute_api_class = cinder.compute.nova.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] config_dir = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] config_source = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] control_exchange = openstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] debug = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] default_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] default_group_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] default_volume_type = lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_ssl_cert_verify = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] driver_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] enable_force_upload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] enable_new_services = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] enable_unsupported_driver = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] enforce_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_api_insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_api_ssl_compression = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_ca_certificates_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_catalog_info = image:glance:publicURL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_num_retries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance_request_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] graceful_shutdown_timeout = 5 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] group_api_class = cinder.group.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] host = devstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_compress_on_upload = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_conversion_address_space_limit = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_conversion_cpu_limit = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_conversion_disable = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_upload_use_cinder_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_upload_use_internal_tenant = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_volume_cache_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_volume_cache_max_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] image_volume_cache_max_size_gb = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] init_host_max_objects_retrieval = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] instance_format = [instance: %(uuid)s] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iscsi_target_flags = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iscsi_write_cache = on {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iser_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iser_ip_address = 192.168.122.251 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iser_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_color = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_config_append = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_options = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_rotate_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_rotate_interval_type = days {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] log_rotation_type = none {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] max_age = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] max_logfile_count = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] max_logfile_size_mb = 200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] max_over_subscription_ratio = 20.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] message_reap_interval = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] message_ttl = 2592000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] migration_create_volume_timeout_secs = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] monkey_patch = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack sudo[76147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] monkey_patch_modules = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] my_ip = 192.168.122.251 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] no_snapshot_gb_quota = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] num_iser_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] num_shell_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] num_volume_device_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] nvmeof_conn_info_version = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack sudo[76147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] nvmet_ns_id = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] nvmet_port_id = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_max_limit = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_ext_list = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_listen_port = 8776 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] osapi_volume_workers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] per_volume_size_limit = -1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] periodic_fuzzy_delay = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] periodic_interval = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] public_endpoint = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] publish_errors = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_backup_gigabytes = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_backups = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_gigabytes = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_groups = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_snapshots = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] quota_volumes = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] rate_limit_burst = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] rate_limit_except_level = CRITICAL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] rate_limit_interval = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] reinit_driver_count = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] report_discard_supported = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] report_interval = 120 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] reservation_clean_interval = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] reservation_expire = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] reserved_image_namespaces = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] reserved_percentage = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] rpc_response_timeout = 120 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] run_external_periodic_tasks = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] scst_target_driver = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_down_time = 720 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] shell_completion = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] snapshot_name_template = snapshot-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] snapshot_same_host = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] state_path = /opt/stack/data/cinder {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] storage_availability_zone = nova {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] storage_protocol = iSCSI {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] syslog_log_facility = LOG_USER {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_helper = lioadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_ip_address = 192.168.122.251 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] target_secondary_ip_addresses = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] transport_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] until_refresh = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_chap_auth = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_default_quota_class = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_journal = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_json = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_stderr = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] use_syslog = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] verify_glance_signatures = enabled {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_api_class = cinder.volume.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_clear_size = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_copy_bps_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_dd_blocksize = 1M {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_name_template = volume-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_service_inithost_offload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volume_usage_audit_period = month {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] zoning_mode = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_concurrency.disable_process_locking = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:15 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.auth_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.cache = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.include_service_catalog = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.interface = public {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_password = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcache_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.service_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.backend = dogpile.cache.null {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.backend_argument = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.backend_expiration_time = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.config_prefix = cache.oslo {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.debug_cache_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.enable_retry_client = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.enable_socket_keepalive = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.expiration_time = 600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.hashclient_retry_attempts = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_dead_retry = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_pool_maxsize = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_sasl_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.proxies = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.redis_db = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.redis_server = localhost:6379 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.retry_attempts = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.retry_delay = 0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.socket_keepalive_count = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.socket_keepalive_idle = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.socket_keepalive_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.socket_timeout = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.tls_allowed_ciphers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.tls_cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.tls_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.tls_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.tls_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cache.username = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] coordination.backend_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.asyncio_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.asyncio_slave_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.backend = sqlalchemy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.connection_debug = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.connection_parameters = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.connection_recycle_time = 3600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.connection_trace = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.db_inc_retry_interval = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.db_max_retries = 20 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.db_max_retry_interval = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.db_retry_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.max_overflow = 50 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.max_pool_size = 5 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.max_retries = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.mysql_wsrep_sync_wait = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.pool_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.retry_interval = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.slave_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.sqlite_synchronous = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.synchronous_reader = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] database.use_db_reconnect = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.connection_string = messaging:// {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.es_doc_type = notification {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.es_scroll_size = 10000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.es_scroll_time = 2m {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.filter_error_trace = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.hmac_keys = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.sentinel_service_name = mymaster {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.socket_timeout = 0.1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.trace_requests = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler.trace_sqlalchemy = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler_jaeger.process_tags = {} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler_jaeger.service_name_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] profiler_otlp.service_name_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.enforce_new_defaults = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.enforce_scope = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.policy_default_rule = default {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.policy_file = policy.yaml {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.group = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.helper_command = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] privsep_osbrick.user = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.group = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.helper_command = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] cinder_sys_admin.user = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.send_service_user_token = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] service_user.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] glance.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.chap_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.driver_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.extra_capabilities = {} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iscsi_target_flags = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iscsi_write_cache = on {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iser_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iser_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.lvm_share_target = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.lvm_type = auto {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.num_shell_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.report_discard_supported = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.reserved_percentage = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.unique_fqdn_network = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.use_chap_auth = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_clear_size = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_reports.file_event_handler = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_reports.log_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.backend_host = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.chap_username = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.extra_capabilities = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iser_helper = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iser_ip_address = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iser_port = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.lvm_share_target = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.lvm_type = auto {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.num_shell_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.report_discard_supported = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.reserved_percentage = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.scst_target_driver = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.storage_protocol = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_helper = lioadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_ip_address = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.use_chap_auth = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_clear_size = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] lvmdriver-1.volumes_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_notifications.driver = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_notifications.retry = -1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] key_manager.fixed_key = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.barbican_api_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.barbican_endpoint = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.barbican_endpoint_type = public {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.barbican_region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.number_of_retries = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.retry_delay = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.send_service_user_token = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.verify_ssl = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican.verify_ssl_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.auth_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] barbican_service_user.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.approle_role_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.approle_secret_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.kv_mountpoint = secret {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.kv_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.kv_version = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.root_token_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.ssl_ca_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:07:16 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] ******************************************************************************** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 16:07:16 devstack sudo[76147]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.758s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:16 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:16 devstack sudo[76264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:16 devstack sudo[76264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:17 devstack sudo[76264]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.680s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:07:17 devstack cinder-volume[76143]: INFO cinder.brick.local_dev.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:17 devstack sudo[76505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:17 devstack sudo[76505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:17 devstack sudo[76505]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG cinder.brick.local_dev.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76143) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 16:07:17 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:17 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:17 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:19 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.191s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:19 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:19 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:19 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:19 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:19 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 16:07:19 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:20 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:20 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.682s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:20 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:20 devstack sudo[76930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:20 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:21 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:21 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:21 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:21 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:21 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:21 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:21 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.773s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:21 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:21 devstack sudo[76946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:21 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:22 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:22 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.818s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:22 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:22 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:22 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:23 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:23 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:23 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:23 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:23 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:23 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:23 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:24 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:24 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:24 devstack cinder-volume[76143]: INFO cinder.volume.drivers.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 16:07:24 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:24 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:24 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:24 devstack sudo[76967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:24 devstack sudo[76967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:25 devstack sudo[76967]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:25 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.838s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:25 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:07:25 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:25 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:25 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:25 devstack cinder-volume[75965]: DEBUG dbcounter [-] [75965] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:07:25 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:25 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:25 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:25 devstack sudo[77177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:25 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:26 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:26 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:26 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:26 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:26 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:27 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:27 devstack sudo[77236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:27 devstack sudo[77236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:27 devstack sudo[77236]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:27 devstack cinder-volume[76143]: INFO cinder.volume.driver [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Driver hasn't implemented _init_vendor_properties() Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG cinder.volume.driver [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76143) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG oslo_db.sqlalchemy.engines [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writer thread running {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG cinder.db.api [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Building query based on filter {{(pid=76143) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG cinder.image.image_utils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76143) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 16:07:27 devstack cinder-volume[76143]: INFO cinder.keymgr.migration [None req-9f294b29-196d-4bec-8f91-9d1f82ec9aa8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:07:27 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:27 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:27 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:28 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:28 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:28 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:28 devstack sudo[77247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:28 devstack sudo[77247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:29 devstack sudo[77247]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:29 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:29 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:29 devstack sudo[77250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:29 devstack sudo[77250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:29 devstack sudo[77250]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:29 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:29 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:29 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:29 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:30 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG cinder.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Notifying Schedulers of capabilities ... {{(pid=76143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:07:30 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Driver initialization completed successfully. Jul 08 16:07:30 devstack cinder-volume[76143]: INFO cinder.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Initiating service 2 cleanup Jul 08 16:07:30 devstack cinder-volume[76143]: INFO cinder.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Service 2 cleanup completed. Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG cinder.service [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Creating RPC server for service cinder-volume {{(pid=76143) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG cinder.service [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76143) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 16:07:30 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:07:30 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:30 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:07:30 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:31 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:31 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:31 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:31 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:31 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:32 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:32 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:07:32 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:32 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:07:32 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:07:32 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:07:33 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Jul 08 16:07:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:07:33 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-1204cbaa-e86b-4da4-99ea-5536cbac61bc None None] Driver post RPC initialization completed successfully. Jul 08 16:07:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:SELECT=3 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:07:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:08:32 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:08:32 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:08:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:08:32 devstack sudo[79058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:08:32 devstack sudo[79058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:08:33 devstack sudo[79058]: pam_unix(sudo:session): session closed for user root Jul 08 16:08:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:08:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:08:33 devstack sudo[79061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:08:33 devstack sudo[79061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:08:33 devstack sudo[79061]: pam_unix(sudo:session): session closed for user root Jul 08 16:08:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:08:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:08:33 devstack sudo[79064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:08:33 devstack sudo[79064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:08:34 devstack sudo[79064]: pam_unix(sudo:session): session closed for user root Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:08:34 devstack sudo[79085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:08:34 devstack sudo[79085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:08:34 devstack sudo[79085]: pam_unix(sudo:session): session closed for user root Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG cinder.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Notifying Schedulers of capabilities ... {{(pid=76143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG cinder.volume.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] thread count: 6 {{(pid=76143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:08:34 devstack cinder-volume[76143]: DEBUG cinder.volume.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] thread info: [<_MainThread(MainThread, started 138166813081728)>, , , , , ] {{(pid=76143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:09:32 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:09:32 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:09:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:09:32 devstack sudo[82423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:09:32 devstack sudo[82423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:09:32 devstack sudo[82423]: pam_unix(sudo:session): session closed for user root Jul 08 16:09:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:09:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:09:33 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:09:33 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:09:33 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Jul 08 16:09:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:09:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:09:33 devstack sudo[82442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:09:33 devstack sudo[82442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:09:34 devstack sudo[82442]: pam_unix(sudo:session): session closed for user root Jul 08 16:09:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:09:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:09:34 devstack sudo[82452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:09:34 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:09:34 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root Jul 08 16:09:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:09:34 devstack cinder-volume[76143]: DEBUG cinder.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Notifying Schedulers of capabilities ... {{(pid=76143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:09:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:SELECT=1 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:09:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:UPDATE=1 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:10:32 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:10:32 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:10:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:10:32 devstack sudo[84501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:10:32 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:10:33 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root Jul 08 16:10:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.762s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:10:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:10:33 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:10:33 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:10:33 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Jul 08 16:10:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.744s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:10:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:10:33 devstack sudo[84525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:10:33 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:10:34 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root Jul 08 16:10:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:10:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:10:34 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:10:34 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:10:35 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Jul 08 16:10:35 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:10:35 devstack cinder-volume[76143]: DEBUG cinder.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Notifying Schedulers of capabilities ... {{(pid=76143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:10:35 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:10:35 devstack cinder-volume[76143]: DEBUG cinder.volume.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] thread count: 6 {{(pid=76143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:10:35 devstack cinder-volume[76143]: DEBUG cinder.volume.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] thread info: [<_MainThread(MainThread, started 138166813081728)>, , , , , ] {{(pid=76143) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:11:32 devstack cinder-volume[76143]: DEBUG oslo_service.periodic_task [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76143) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:11:32 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Updating volume stats {{(pid=76143) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 16:11:32 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:32 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 16:11:32 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:33 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:33 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:11:33 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:33 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:33 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 16:11:33 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:34 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:34 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:34 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 16:11:34 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:34 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:35 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:35 devstack cinder-volume[76143]: DEBUG cinder.manager [None req-343648f0-1ec1-4dd2-8f37-88c72adf98a5 None None] Notifying Schedulers of capabilities ... {{(pid=76143) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:11:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:SELECT=1 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:11:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:UPDATE=1 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:11:48 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Caught SIGTERM, stopping children Jul 08 16:11:48 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Acquiring lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:11:48 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Acquired lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:11:48 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Releasing lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:11:48 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Stop services. {{(pid=75965) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 16:11:48 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Killing children. {{(pid=75965) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 16:11:48 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Waiting on 1 children to exit Jul 08 16:11:50 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Acquiring lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:11:50 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Acquired lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:11:50 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Releasing lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:11:50 devstack cinder-volume[76143]: WARNING amqp [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 16:11:50 devstack cinder-volume[76143]: WARNING amqp [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 16:11:50 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-f93a7668-8f1d-4e91-bbbd-b201c2199299 None None] Child 76143 exited with status 0 Jul 08 16:11:51 devstack cinder-volume[86267]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 16:11:51 devstack cinder-volume[86267]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 16:11:51 devstack cinder-volume[86267]: we strongly recommend against using it for new projects. Jul 08 16:11:51 devstack cinder-volume[86267]: If you are already using Eventlet, we recommend migrating to a different Jul 08 16:11:51 devstack cinder-volume[86267]: framework. For more detail see Jul 08 16:11:51 devstack cinder-volume[86267]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 16:11:51 devstack cinder-volume[86267]: import eventlet # noqa Jul 08 16:11:53 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:11:53 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:11:53 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:11:53 devstack cinder-volume[86267]: INFO dbcounter [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Registered counter for database cinder Jul 08 16:11:53 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG dbcounter [-] [86267] Writer thread running {{(pid=86267) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:11:54 devstack cinder-volume[86267]: INFO cinder.rpc [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 16:11:54 devstack cinder-volume[86267]: INFO cinder.rpc [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:11:54 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Determined volume DB was empty at startup. Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG cinder.volume.manager [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86267) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 16:11:54 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 16:11:54 devstack cinder-volume[86267]: WARNING stevedore.named [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 16:11:54 devstack cinder-volume[86267]: WARNING castellan.key_manager [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:11:54 devstack cinder-volume[86267]: WARNING cinder.keymgr.conf_key_mgr [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:11:54 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:11:54 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Starting 1 workers Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Started child 86481 {{(pid=86267) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Full set of CONF: {{(pid=86267) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] ******************************************************************************** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Configuration options gathered from: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] ================================================================================ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] allow_availability_zone_fallback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] allow_compression_on_image_upload = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] allowed_direct_url_schemes = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] api_rate_limit = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] auth_strategy = keystone {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86481]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_stats_polling_interval = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backup_api_class = cinder.backup.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backup_name_template = backup-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backup_use_same_host = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backup_use_temp_snapshot = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] chap_username = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_internal_tenant_project_id = 40f7f1820cf74301a3f3b2d98d5c981a {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_internal_tenant_user_id = db4f298ada6a4c02b7b1dcefe7ac787e {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cluster = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] compression_format = gzip {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] compute_api_class = cinder.compute.nova.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] config_dir = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] config_source = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] control_exchange = openstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] debug = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] default_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] default_group_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] default_volume_type = QuobyteHD {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_ssl_cert_verify = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] driver_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] enable_new_services = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] enable_unsupported_driver = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] enabled_backends = ['QuobyteHD'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] enforce_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_api_insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_api_ssl_compression = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_ca_certificates_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_catalog_info = image:glance:publicURL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_num_retries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance_request_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] graceful_shutdown_timeout = 5 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] group_api_class = cinder.group.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] host = devstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_compress_on_upload = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_conversion_address_space_limit = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_conversion_cpu_limit = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_conversion_disable = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_upload_use_cinder_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_upload_use_internal_tenant = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_volume_cache_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_volume_cache_max_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] image_volume_cache_max_size_gb = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] init_host_max_objects_retrieval = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] instance_format = [instance: %(uuid)s] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iscsi_target_flags = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iscsi_write_cache = on {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iser_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86481) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iser_ip_address = 192.168.122.251 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iser_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_color = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_config_append = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_options = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_rotate_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_rotate_interval_type = days {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] log_rotation_type = none {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] max_age = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] max_logfile_count = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] max_logfile_size_mb = 200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] max_over_subscription_ratio = 20.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] message_reap_interval = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] message_ttl = 2592000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] migration_create_volume_timeout_secs = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] monkey_patch = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] monkey_patch_modules = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] my_ip = 192.168.122.251 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] no_snapshot_gb_quota = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] num_iser_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] num_shell_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] num_volume_device_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] nvmeof_conn_info_version = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] nvmet_ns_id = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] nvmet_port_id = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_max_limit = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_ext_list = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_listen_port = 8776 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] osapi_volume_workers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] per_volume_size_limit = -1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] periodic_fuzzy_delay = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] periodic_interval = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] public_endpoint = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] publish_errors = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_backup_gigabytes = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_backups = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_gigabytes = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_groups = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_snapshots = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] quota_volumes = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] rate_limit_burst = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] rate_limit_except_level = CRITICAL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] rate_limit_interval = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] reinit_driver_count = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] report_discard_supported = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] report_interval = 120 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] reservation_clean_interval = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] reservation_expire = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] reserved_image_namespaces = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] reserved_percentage = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] rpc_response_timeout = 120 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] run_external_periodic_tasks = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] scst_target_driver = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_down_time = 720 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] shell_completion = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] snapshot_name_template = snapshot-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] state_path = /opt/stack/data/cinder {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] storage_availability_zone = nova {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] storage_protocol = iSCSI {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] syslog_log_facility = LOG_USER {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_helper = lioadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_ip_address = 192.168.122.251 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_protocol = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] target_secondary_ip_addresses = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] transport_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] until_refresh = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_chap_auth = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_default_quota_class = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_journal = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_json = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_stderr = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] use_syslog = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] verify_glance_signatures = enabled {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_api_class = cinder.volume.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_clear = zero {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_clear_size = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_copy_bps_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_dd_blocksize = 1M {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_name_template = volume-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_service_inithost_offload = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volume_usage_audit_period = month {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] zoning_mode = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_concurrency.disable_process_locking = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.auth_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.include_service_catalog = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.interface = public {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_password = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcache_username = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.service_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.backend = dogpile.cache.null {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.backend_argument = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.backend_expiration_time = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.config_prefix = cache.oslo {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.debug_cache_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.enable_retry_client = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.enable_socket_keepalive = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.expiration_time = 600 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.hashclient_retry_attempts = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_dead_retry = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_pool_maxsize = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_sasl_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.proxies = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.redis_db = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.redis_server = localhost:6379 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.retry_attempts = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.retry_delay = 0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.socket_keepalive_count = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.socket_keepalive_idle = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.socket_keepalive_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.socket_timeout = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.tls_allowed_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.tls_cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.tls_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.tls_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.tls_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cache.username = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] coordination.backend_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.asyncio_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.asyncio_slave_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.backend = sqlalchemy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.connection_debug = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.connection_parameters = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.connection_recycle_time = 3600 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.connection_trace = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.db_inc_retry_interval = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.db_max_retries = 20 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.db_max_retry_interval = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.db_retry_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.max_overflow = 50 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.max_pool_size = 5 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.max_retries = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.mysql_wsrep_sync_wait = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.pool_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.retry_interval = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.slave_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.sqlite_synchronous = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.synchronous_reader = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] database.use_db_reconnect = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.connection_string = messaging:// {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.es_doc_type = notification {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.es_scroll_size = 10000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.es_scroll_time = 2m {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.filter_error_trace = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.hmac_keys = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.sentinel_service_name = mymaster {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.socket_timeout = 0.1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.trace_requests = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86481) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 16:11:54 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 16:11:54 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler.trace_sqlalchemy = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler_jaeger.process_tags = {} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler_jaeger.service_name_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] profiler_otlp.service_name_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.enforce_new_defaults = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.enforce_scope = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.policy_default_rule = default {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.policy_file = policy.yaml {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.group = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.helper_command = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] privsep_osbrick.user = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.group = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.helper_command = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] cinder_sys_admin.user = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.send_service_user_token = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] service_user.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] glance.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.chap_username = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.driver_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.extra_capabilities = {} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iscsi_target_flags = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iscsi_write_cache = on {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iser_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iser_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_host = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_login = admin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_mount_options = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_private_key = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_share_path = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.num_shell_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.quobyte_volume_url = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.report_discard_supported = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.reserved_percentage = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_protocol = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.unique_fqdn_network = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.use_chap_auth = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_clear = zero {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_clear_size = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_reports.file_event_handler = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_reports.log_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.backend_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.chap_username = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.chiscsi_conf = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.driver_use_ssl = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.extra_capabilities = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iser_helper = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iser_ip_address = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iser_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.iser_target_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_login = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_mount_options = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_private_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_share_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_ssh_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.num_shell_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.nvmet_port_id = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.report_discard_supported = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.reserved_percentage = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.scst_target_driver = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.storage_protocol = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_helper = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_ip_address = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_protocol = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.use_chap_auth = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_clear = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_clear_size = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] QuobyteHD.volumes_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: INFO cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 ... Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c -c /etc/quobyte/client-cinder.cfg {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_notifications.driver = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_notifications.retry = -1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] key_manager.fixed_key = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.barbican_api_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.barbican_endpoint = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.barbican_endpoint_type = public {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.barbican_region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.number_of_retries = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.retry_delay = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.send_service_user_token = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.verify_ssl = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican.verify_ssl_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.auth_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] barbican_service_user.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.approle_role_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.approle_secret_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.kv_mountpoint = secret {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c -c /etc/quobyte/client-cinder.cfg Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.kv_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.kv_version = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.root_token_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.ssl_ca_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:11:54 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] ******************************************************************************** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 16:11:55 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.750s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:55 devstack cinder-volume[86481]: INFO cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 succeeded Jul 08 16:11:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:11:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.767s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:11:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:55 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:11:55 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:56 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.619s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:56 devstack cinder-volume[86481]: INFO cinder.volume.driver [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG cinder.volume.driver [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.703525543213, 'free_capacity_gb': 1775.703525543213, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86481) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_db.sqlalchemy.engines [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86481) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writer thread running {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG cinder.db.api [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Building query based on filter {{(pid=86481) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86481) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 16:11:56 devstack cinder-volume[86481]: INFO cinder.keymgr.migration [None req-433ad9ef-0ba8-4763-b1e4-07a1808c2424 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:11:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:56 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:11:56 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:57 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.608s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:11:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Driver initialization completed successfully. Jul 08 16:11:57 devstack cinder-volume[86481]: INFO cinder.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Initiating service 3 cleanup Jul 08 16:11:57 devstack cinder-volume[86481]: INFO cinder.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Service 3 cleanup completed. Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG cinder.service [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Creating RPC server for service cinder-volume {{(pid=86481) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG cinder.service [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86481) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 16:11:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:11:57 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:11:57 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:11:57 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Jul 08 16:11:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.714s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:11:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-df31fdcc-443a-48a9-9300-37f25e191af3 None None] Driver post RPC initialization completed successfully. Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:12:02 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:12:02 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:12:02 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.611s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:12:02 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4c9cbf8d-36ad-45d5-b0ec-4ac3cda34d54 None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:12:04 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Caught SIGTERM, stopping children Jul 08 16:12:04 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Acquiring lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:12:04 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Acquired lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:12:04 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Releasing lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:12:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Stop services. {{(pid=86267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 16:12:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Killing children. {{(pid=86267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 16:12:04 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Waiting on 1 children to exit Jul 08 16:12:07 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:12:08 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:12:09 devstack cinder-volume[86481]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 16:12:09 devstack cinder-volume[86920]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 16:12:09 devstack cinder-volume[86920]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 16:12:09 devstack cinder-volume[86920]: we strongly recommend against using it for new projects. Jul 08 16:12:09 devstack cinder-volume[86920]: If you are already using Eventlet, we recommend migrating to a different Jul 08 16:12:09 devstack cinder-volume[86920]: framework. For more detail see Jul 08 16:12:09 devstack cinder-volume[86920]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 16:12:09 devstack cinder-volume[86920]: import eventlet # noqa Jul 08 16:12:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Acquiring lock "singleton_lock" {{(pid=86481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:12:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Acquired lock "singleton_lock" {{(pid=86481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:12:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Releasing lock "singleton_lock" {{(pid=86481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:12:10 devstack cinder-volume[86481]: WARNING amqp [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 16:12:10 devstack cinder-volume[86481]: WARNING amqp [None req-fa2307d4-8084-4225-a18a-1079bcb7d224 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 16:12:12 devstack cinder-volume[86920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 16:12:12 devstack cinder-volume[86920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 16:12:12 devstack cinder-volume[86920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86920) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 16:12:13 devstack cinder-volume[86920]: INFO dbcounter [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Registered counter for database cinder Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_db.sqlalchemy.engines [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG dbcounter [-] [86920] Writer thread running {{(pid=86920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:12:13 devstack cinder-volume[86920]: INFO cinder.rpc [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 16:12:13 devstack cinder-volume[86920]: INFO cinder.rpc [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_db.sqlalchemy.engines [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:12:13 devstack cinder-volume[86920]: INFO cinder.volume.manager [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Determined volume DB was empty at startup. Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG cinder.volume.manager [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86920) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 16:12:13 devstack cinder-volume[86920]: WARNING stevedore.named [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 16:12:13 devstack cinder-volume[86920]: WARNING castellan.key_manager [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:12:13 devstack cinder-volume[86920]: WARNING cinder.keymgr.conf_key_mgr [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 16:12:13 devstack cinder-volume[86920]: INFO cinder.volume.manager [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_db.sqlalchemy.engines [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:12:13 devstack cinder-volume[86920]: INFO oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Starting 1 workers Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Started child 87227 {{(pid=86920) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Full set of CONF: {{(pid=86920) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] ******************************************************************************** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] Configuration options gathered from: {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] ================================================================================ {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] allow_availability_zone_fallback = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] allow_compression_on_image_upload = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[87227]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] allowed_direct_url_schemes = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] api_rate_limit = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] auth_strategy = keystone {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_availability_zone = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_host = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_stats_polling_interval = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backup_api_class = cinder.backup.api.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backup_name_template = backup-%s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backup_use_same_host = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backup_use_temp_snapshot = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] chap_password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] chap_username = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_internal_tenant_project_id = 40f7f1820cf74301a3f3b2d98d5c981a {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_internal_tenant_user_id = db4f298ada6a4c02b7b1dcefe7ac787e {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cluster = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] compression_format = gzip {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] config_dir = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] config_source = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] control_exchange = openstack {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] debug = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] default_availability_zone = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] default_group_type = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] default_volume_type = QuobyteHD {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] disk_geometry = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_client_cert = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_client_cert_key = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_data_namespace = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_ssl_cert_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_ssl_cert_verify = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] driver_use_ssl = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] enable_new_services = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] enable_unsupported_driver = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] enforce_multipath_for_image_xfer = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] filter_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_api_insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_api_ssl_compression = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_ca_certificates_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_num_retries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance_request_timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] goodness_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] graceful_shutdown_timeout = 5 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] group_api_class = cinder.group.api.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] host = devstack {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_compress_on_upload = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_conversion_address_space_limit = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_conversion_cpu_limit = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_conversion_disable = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_upload_use_cinder_backend = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_upload_use_internal_tenant = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_volume_cache_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_volume_cache_max_count = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] init_host_max_objects_retrieval = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] instance_format = [instance: %(uuid)s] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:13 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iscsi_target_flags = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iscsi_write_cache = on {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iser_helper = tgtadm {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iser_ip_address = 192.168.122.251 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iser_port = 3260 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_color = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_config_append = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_dir = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_options = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_rotate_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_rotate_interval_type = days {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] log_rotation_type = none {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] max_age = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] max_logfile_count = 30 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] max_logfile_size_mb = 200 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] max_over_subscription_ratio = 20.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] message_reap_interval = 86400 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] message_ttl = 2592000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] monkey_patch = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] monkey_patch_modules = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] my_ip = 192.168.122.251 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] no_snapshot_gb_quota = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] num_iser_scan_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] num_shell_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] num_volume_device_scan_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] nvmeof_conn_info_version = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] nvmet_ns_id = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] nvmet_port_id = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_max_limit = 1000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_ext_list = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 16:12:14 devstack quobyte-client[87231]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack quobyte-client[87231]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87227) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_listen_port = 8776 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_use_ssl = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] osapi_volume_workers = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] per_volume_size_limit = -1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] periodic_fuzzy_delay = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] periodic_interval = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] public_endpoint = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] publish_errors = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_backup_gigabytes = 1000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_backups = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_gigabytes = 1000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_groups = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_snapshots = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] quota_volumes = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] rate_limit_burst = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] rate_limit_except_level = CRITICAL {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] rate_limit_interval = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] reinit_driver_count = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] replication_device = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] report_discard_supported = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] report_interval = 120 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] reservation_clean_interval = 86400 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] reservation_expire = 86400 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] reserved_image_namespaces = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] reserved_percentage = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] rpc_response_timeout = 120 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] run_external_periodic_tasks = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] scst_target_driver = iscsi {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] scst_target_iqn_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_down_time = 720 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] shell_completion = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] snapshot_name_template = snapshot-%s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] split_loggers = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] state_path = /opt/stack/data/cinder {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] storage_availability_zone = nova {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] storage_protocol = iSCSI {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] syslog_log_facility = LOG_USER {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_helper = lioadm {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_ip_address = 192.168.122.251 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_port = 3260 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_protocol = iscsi {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] target_secondary_ip_addresses = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] trace_flags = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] transport_url = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] until_refresh = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_chap_auth = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_default_quota_class = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_journal = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_json = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_multipath_for_image_xfer = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_stderr = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] use_syslog = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] verify_glance_signatures = enabled {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_api_class = cinder.volume.api.API {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_backend_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_clear = zero {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_clear_ionice = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_clear_size = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_copy_bps_limit = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_dd_blocksize = 1M {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_name_template = volume-%s {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_service_inithost_offload = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volume_usage_audit_period = month {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] zoning_mode = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.auth_section = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.auth_type = password {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.auth_version = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.cache = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.interface = public {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_password = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcache_username = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.region_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.service_type = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.backend = dogpile.cache.null {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.backend_argument = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.backend_expiration_time = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.config_prefix = cache.oslo {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.debug_cache_backend = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.enable_retry_client = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.enable_socket_keepalive = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.expiration_time = 600 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_dead_retry = 300 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_sasl_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.proxies = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.redis_db = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.redis_server = localhost:6379 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.retry_attempts = 2 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.retry_delay = 0.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.socket_keepalive_count = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.socket_keepalive_idle = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.socket_keepalive_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.socket_timeout = 1.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.tls_allowed_ciphers = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.tls_cafile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.tls_certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.tls_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.tls_keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cache.username = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] coordination.backend_url = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.asyncio_connection = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.asyncio_slave_connection = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.backend = sqlalchemy {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.connection = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.connection_debug = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.connection_parameters = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.connection_recycle_time = 3600 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.connection_trace = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.db_inc_retry_interval = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.db_max_retries = 20 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.db_max_retry_interval = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.db_retry_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.max_overflow = 50 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.max_pool_size = 5 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.max_retries = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.pool_timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.retry_interval = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.slave_connection = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.sqlite_synchronous = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.synchronous_reader = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] database.use_db_reconnect = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.connection_string = messaging:// {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.es_doc_type = notification {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.es_scroll_size = 10000 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.es_scroll_time = 2m {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.filter_error_trace = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.hmac_keys = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.sentinel_service_name = mymaster {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.socket_timeout = 0.1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.trace_requests = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler.trace_sqlalchemy = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler_jaeger.process_tags = {} {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] profiler_otlp.service_name_prefix = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.enforce_scope = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.policy_default_rule = default {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.group = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.helper_command = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] privsep_osbrick.user = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.group = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.helper_command = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] cinder_sys_admin.user = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.auth_section = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.auth_type = password {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.cafile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.collect_timing = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.send_service_user_token = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.split_loggers = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] service_user.timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.auth_section = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.auth_type = password {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.collect_timing = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.region_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.split_loggers = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] glance.timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.backend_availability_zone = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.chap_password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.chap_username = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.disk_geometry = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_client_cert = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_data_namespace = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.driver_use_ssl = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.extra_capabilities = {} {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.filter_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.goodness_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iscsi_target_flags = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87227) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iser_port = 3260 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_host = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_login = admin {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_mount_options = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_private_key = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_share_path = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 16:12:14 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Running cmd (subprocess): mount.quobyte {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.replication_device = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.report_discard_supported = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_helper = tgtadm {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_port = 3260 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_protocol = iscsi {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.trace_flags = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.use_chap_auth = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_backend_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_clear = zero {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_reports.file_event_handler = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_reports.log_dir = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.backend_host = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.chap_password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.chap_username = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.disk_geometry = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_client_cert = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.extra_capabilities = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.filter_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.goodness_function = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iser_helper = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iser_ip_address = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iser_port = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_host = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_login = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_mount_options = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_password = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_private_key = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_share_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.num_shell_tries = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.replication_device = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.report_discard_supported = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.reserved_percentage = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.scst_target_driver = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.storage_protocol = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_helper = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_ip_address = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_port = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_prefix = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_protocol = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.trace_flags = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.use_chap_auth = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_clear = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_clear_size = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] QuobyteHD.volumes_dir = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_notifications.driver = [] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] key_manager.fixed_key = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.barbican_api_version = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.barbican_endpoint = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.barbican_endpoint_type = public {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.barbican_region_name = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.cafile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.collect_timing = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.number_of_retries = 60 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.retry_delay = 1 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.send_service_user_token = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.split_loggers = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.verify_ssl = True {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican.verify_ssl_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.auth_section = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.auth_type = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.cafile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.certfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.collect_timing = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.insecure = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.keyfile = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.split_loggers = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] barbican_service_user.timeout = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.approle_role_id = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.approle_secret_id = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.kv_mountpoint = secret {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.kv_path = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.kv_version = 2 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.namespace = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.root_token_id = **** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.ssl_ca_crt_file = None {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.timeout = 60.0 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.use_ssl = False {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 16:12:14 devstack cinder-volume[86920]: DEBUG oslo_service.backend._eventlet.service [None req-145b31f6-72ac-4afe-9383-ddfd082e08f4 None None] ******************************************************************************** {{(pid=86920) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:12:14 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:12:14 devstack cinder-volume[87227]: INFO cinder.volume.driver [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.driver [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940689086914, 'free_capacity_gb': 1775.6940689086914, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87227) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_db.sqlalchemy.engines [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writer thread running {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.db.api [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Building query based on filter {{(pid=87227) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87227) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:12:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:12:14 devstack cinder-volume[87227]: INFO cinder.keymgr.migration [None req-a0b8b672-7a4e-4523-92ec-217babc508c1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 16:12:14 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:12:14 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:12:15 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.618s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:12:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Driver initialization completed successfully. Jul 08 16:12:15 devstack cinder-volume[87227]: INFO cinder.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Initiating service 3 cleanup Jul 08 16:12:15 devstack cinder-volume[87227]: INFO cinder.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Service 3 cleanup completed. Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG cinder.service [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Creating RPC server for service cinder-volume {{(pid=87227) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG cinder.service [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87227) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 16:12:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:12:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:12:15 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:12:15 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:12:16 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Jul 08 16:12:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.643s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:12:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-923b3c06-1ff6-47d6-b9f5-f7769c142ca4 None None] Driver post RPC initialization completed successfully. Jul 08 16:12:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:12:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 6 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:12:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:12:23 devstack cinder-volume[86920]: DEBUG dbcounter [-] [86920] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86920) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:12:25 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=2 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:12:26 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Flow 'volume_create_manager' (85a0f876-c585-40de-8940-8953b83fb5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a711934-0945-4375-a319-399f766dd793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a711934-0945-4375-a319-399f766dd793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1038379528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf6406a-d958-4039-a9b5-57e75bde1ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad895bef01c947bf9caab12c92105a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:11Z,use_quota=True,user_id='705415991fa24bfa89e6e1aef64956ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50820f6-d0ea-4496-8579-bc305e0dbc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50820f6-d0ea-4496-8579-bc305e0dbc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd23776-5a6e-4406-945c-9a7b553b2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd23776-5a6e-4406-945c-9a7b553b2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf6406a-d958-4039-a9b5-57e75bde1ecb', 'volume_name': 'volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237a52a-b69e-4707-b92d-eaa8e0053fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237a52a-b69e-4707-b92d-eaa8e0053fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740d4dcd-952c-4738-8297-2192ac2a6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:11 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Volume 1bf6406a-d958-4039-a9b5-57e75bde1ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb', 'volume_size': 1} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1038379528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf6406a-d958-4039-a9b5-57e75bde1ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad895bef01c947bf9caab12c92105a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:11Z,use_quota=True,user_id='705415991fa24bfa89e6e1aef64956ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Creating volume 1bf6406a-d958-4039-a9b5-57e75bde1ecb {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:13:11 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:13:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:11 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb 1073741824 Jul 08 16:13:11 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:13 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb 1073741824" returned: 0 in 1.780s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:13 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb Jul 08 16:13:13 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:14 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb" returned: 0 in 1.236s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] <== create_volume: return (3134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.141s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740d4dcd-952c-4738-8297-2192ac2a6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1270a4ee-2ad3-4021-8bb3-05a7b63c44e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:14 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Volume volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb (1bf6406a-d958-4039-a9b5-57e75bde1ecb): created successfully Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1270a4ee-2ad3-4021-8bb3-05a7b63c44e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Flow 'volume_create_manager' (85a0f876-c585-40de-8940-8953b83fb5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3dd9e96e-99a6-4e03-8d2a-6fcaf6f96df2 tempest-TaggedAttachmentsTest-1408214655 None] Created volume successfully. Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:19 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:13:19 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:20 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.287s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:13:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:13:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 6 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:13:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:13:24 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:13:25 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Flow 'volume_create_manager' (f27ddd0a-d7a3-4ba2-807b-482b7f6d7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2967c2e6-706f-475f-b35f-32fa38410cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2967c2e6-706f-475f-b35f-32fa38410cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1091822722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32694f-f22e-412b-a3d8-21579c49855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e1d601e5c74194a2a616aad730f6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:33Z,use_quota=True,user_id='f2ff50d4d9e94931b40ea3a4a4d04071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9668e1b0-6c5c-4671-b948-6c0b755c8630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9668e1b0-6c5c-4671-b948-6c0b755c8630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d0ce1c-49fc-4022-8e8c-1e0fed724aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d0ce1c-49fc-4022-8e8c-1e0fed724aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e32694f-f22e-412b-a3d8-21579c49855e', 'volume_name': 'volume-5e32694f-f22e-412b-a3d8-21579c49855e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05270984-d02b-4841-bbf1-6a3720a4063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05270984-d02b-4841-bbf1-6a3720a4063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7215728d-1fe3-45f6-afbe-12cefc2857b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Volume 5e32694f-f22e-412b-a3d8-21579c49855e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e32694f-f22e-412b-a3d8-21579c49855e', 'volume_size': 1} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1091822722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32694f-f22e-412b-a3d8-21579c49855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e1d601e5c74194a2a616aad730f6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:33Z,use_quota=True,user_id='f2ff50d4d9e94931b40ea3a4a4d04071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Creating volume 5e32694f-f22e-412b-a3d8-21579c49855e {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:13:32 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:13:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:32 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e 1073741824 Jul 08 16:13:32 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:33 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e 1073741824" returned: 0 in 1.007s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:34 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e Jul 08 16:13:34 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:34 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e" returned: 0 in 0.751s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7215728d-1fe3-45f6-afbe-12cefc2857b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e32694f-f22e-412b-a3d8-21579c49855e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e489c1-2e92-423f-896c-05f8ad2ec2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Volume volume-5e32694f-f22e-412b-a3d8-21579c49855e (5e32694f-f22e-412b-a3d8-21579c49855e): created successfully Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e489c1-2e92-423f-896c-05f8ad2ec2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Flow 'volume_create_manager' (f27ddd0a-d7a3-4ba2-807b-482b7f6d7ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f0372496-7ab3-4b14-b803-47ddbd5b562c tempest-DeleteServersTestJSON-2059721235 None] Created volume successfully. Jul 08 16:13:43 devstack cinder-volume[87227]: WARNING py.warnings [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 16:13:43 devstack cinder-volume[87227]: .first() Jul 08 16:13:43 devstack cinder-volume[87227]: Jul 08 16:13:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:43 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu33mng0w/privsep.sock'] Jul 08 16:13:43 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu33mng0w/privsep.sock Jul 08 16:13:43 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:44 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 16:13:45 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Flow 'volume_create_manager' (78799ca0-41f9-4291-a5de-e3774ff55b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b79b71-1047-4bf0-8090-8428d6715920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b79b71-1047-4bf0-8090-8428d6715920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-868485749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1cac50-4d90-45a9-bf45-c15c9e772676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5368b777f3d448f58a8b45d9e7640879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:47Z,use_quota=True,user_id='5aff3ee447824663b6ce7b51374dcc4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb471df-5e88-4b42-a5ce-497246be52b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb471df-5e88-4b42-a5ce-497246be52b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521b8e7a-727f-4db7-8451-9473ad4534ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521b8e7a-727f-4db7-8451-9473ad4534ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1cac50-4d90-45a9-bf45-c15c9e772676', 'volume_name': 'volume-5e1cac50-4d90-45a9-bf45-c15c9e772676', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c3b6c-c2f0-407a-9164-0246d7ff99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c3b6c-c2f0-407a-9164-0246d7ff99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e118c-edd9-4537-bbea-abff068eae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Volume 5e1cac50-4d90-45a9-bf45-c15c9e772676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1cac50-4d90-45a9-bf45-c15c9e772676', 'volume_size': 1} Jul 08 16:13:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 16:13:46 devstack cinder-volume[87227]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 16:13:47 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:47 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Spawned new privsep daemon via rootwrap Jul 08 16:13:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Accepted privsep connection to /tmp/tmpu33mng0w/privsep.sock {{(pid=87227) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 16:13:47 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 16:13:47 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 16:13:47 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 16:13:47 devstack cinder-volume[87227]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88295 Jul 08 16:13:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592380b-0f7b-4318-8523-475368549f78]: (2,) {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:13:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c4d9b-cd1d-4846-bc92-b50c9a3b5d49]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:13:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:47 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e Jul 08 16:13:47 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:48 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e" returned: 0 in 0.894s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.361s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-868485749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1cac50-4d90-45a9-bf45-c15c9e772676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5368b777f3d448f58a8b45d9e7640879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:13:47Z,use_quota=True,user_id='5aff3ee447824663b6ce7b51374dcc4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Creating volume 5e1cac50-4d90-45a9-bf45-c15c9e772676 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:13:48 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:48 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 1073741824 Jul 08 16:13:48 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-5e32694f-f22e-412b-a3d8-21579c49855e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd9fb0d3-4c5b-46c4-bf6e-7804ca84655b', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:13:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-c7c43dcb-3688-46b7-96be-bf7c7461fb27 req-75faa758-34af-4875-a974-9eee692c191d tempest-DeleteServersTestJSON-2059721235 None] attachment_update completed successfully. Jul 08 16:13:49 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 1073741824" returned: 0 in 1.175s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:13:49 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 Jul 08 16:13:49 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:13:50 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676" returned: 0 in 0.936s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e118c-edd9-4537-bbea-abff068eae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1cac50-4d90-45a9-bf45-c15c9e772676', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2315ed0-baac-4258-9770-969d36941395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:13:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Volume volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 (5e1cac50-4d90-45a9-bf45-c15c9e772676): created successfully Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2315ed0-baac-4258-9770-969d36941395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:13:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Flow 'volume_create_manager' (78799ca0-41f9-4291-a5de-e3774ff55b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:13:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-df5bd7b2-4b65-43b2-9d32-c6ee00f94084 tempest-AttachVolumeShelveTestJSON-354937171 None] Created volume successfully. Jul 08 16:13:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-617e8e71-12da-4986-9077-c26aacbbc18d req-fff4aa54-7abc-4ad5-8114-7ebd0587dfb9 tempest-DeleteServersTestJSON-2059721235 None] Terminate volume connection completed successfully. Jul 08 16:13:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-617e8e71-12da-4986-9077-c26aacbbc18d req-fff4aa54-7abc-4ad5-8114-7ebd0587dfb9 tempest-DeleteServersTestJSON-2059721235 None] Deleting attachment bd9fb0d3-4c5b-46c4-bf6e-7804ca84655b. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "cinder-5e32694f-f22e-412b-a3d8-21579c49855e-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "cinder-5e32694f-f22e-412b-a3d8-21579c49855e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "cinder-quobyte-5e32694f-f22e-412b-a3d8-21579c49855e" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "cinder-quobyte-5e32694f-f22e-412b-a3d8-21579c49855e" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a47aca-399e-4efa-973a-3dad89f0e333]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:03 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e Jul 08 16:14:03 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:04 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e" returned: 0 in 0.941s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:04 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e Jul 08 16:14:04 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:05 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e32694f-f22e-412b-a3d8-21579c49855e" returned: 0 in 0.921s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "cinder-quobyte-5e32694f-f22e-412b-a3d8-21579c49855e" released by "delete_volume" :: held 1.920s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:05 devstack cinder-volume[87227]: WARNING cinder.quota [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:14:05 devstack cinder-volume[87227]: WARNING cinder.quota [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Created reservations ['634d5f92-e27b-430a-a1dd-3d73f0abd772', 'ad78819b-dfc3-49a5-86ee-8cb1b9648022', 'e6c2577a-d003-4c36-868d-d8667bbac19e', 'd4f34eff-3234-4fa3-b410-af7894f64623'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:05 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:05 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:06 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.723s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:06 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Deleted volume successfully. Jul 08 16:14:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3721fe98-c091-4bcf-a6f6-7bbaf806a272 tempest-DeleteServersTestJSON-2059721235 None] Lock "cinder-5e32694f-f22e-412b-a3d8-21579c49855e-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-ed1855d9-61c4-4059-ba94-5e3e35266c19 req-bb18e13d-5a26-4b7c-9dfd-cd23dc41f97b tempest-AttachVolumeShelveTestJSON-354937171 None] No connector for attachment f8914a09-c491-4308-b406-a091fdee5e5b; skipping storage backend terminate_connection call. {{(pid=87227) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 16:14:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-ed1855d9-61c4-4059-ba94-5e3e35266c19 req-bb18e13d-5a26-4b7c-9dfd-cd23dc41f97b tempest-AttachVolumeShelveTestJSON-354937171 None] Deleting attachment f8914a09-c491-4308-b406-a091fdee5e5b. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Flow 'volume_create_manager' (088ef9a8-09f6-46dc-9290-fe9f0736fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a660f3a-0e0b-49e3-814f-562aadcd9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a660f3a-0e0b-49e3-814f-562aadcd9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-340602604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0461063-05df-4b2d-96ed-7b34ba0318c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1594ecc8107145e793e8cc92399c3b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:17Z,use_quota=True,user_id='c0f8db91e34f4a04b2e27cb677e48369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbdec9c-68ce-4427-890c-d6c9070fa1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbdec9c-68ce-4427-890c-d6c9070fa1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc3c18-8980-4b48-b42c-efe49c682cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc3c18-8980-4b48-b42c-efe49c682cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0461063-05df-4b2d-96ed-7b34ba0318c0', 'volume_name': 'volume-a0461063-05df-4b2d-96ed-7b34ba0318c0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686be607-4abf-4ce4-8a55-ba344159a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686be607-4abf-4ce4-8a55-ba344159a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525effb-9fb9-4ded-a6f3-764505a9ecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Volume a0461063-05df-4b2d-96ed-7b34ba0318c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0461063-05df-4b2d-96ed-7b34ba0318c0', 'volume_size': 1} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-340602604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0461063-05df-4b2d-96ed-7b34ba0318c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1594ecc8107145e793e8cc92399c3b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:17Z,use_quota=True,user_id='c0f8db91e34f4a04b2e27cb677e48369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Creating volume a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:14:16 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:14:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:16 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 1073741824 Jul 08 16:14:16 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:18 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 1073741824" returned: 0 in 1.136s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:18 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 Jul 08 16:14:18 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:18 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0" returned: 0 in 0.747s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525effb-9fb9-4ded-a6f3-764505a9ecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0461063-05df-4b2d-96ed-7b34ba0318c0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4692a2-923f-42e0-87b2-7143a5dadba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:18 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Volume volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 (a0461063-05df-4b2d-96ed-7b34ba0318c0): created successfully Jul 08 16:14:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4692a2-923f-42e0-87b2-7143a5dadba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Flow 'volume_create_manager' (088ef9a8-09f6-46dc-9290-fe9f0736fa64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-5387fe73-5393-45c5-a539-d0887879e52b req-9a05916e-f04d-4b76-860c-29925a848013 tempest-VolumesSnapshotsTestJSON-112291989 None] Created volume successfully. Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:19 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:19 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:20 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.825s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Creating offline snapshot 3521a338-0bff-45ca-9e1e-47c3679bd1da of volume a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd722e1-cd40-45ec-b872-8af03bba567b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:20 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 Jul 08 16:14:20 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:21 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0" returned: 0 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:21 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da 1G Jul 08 16:14:21 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:22 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da 1G" returned: 0 in 0.809s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:22 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da Jul 08 16:14:22 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:22 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da" returned: 0 in 0.799s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:23 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da is being set with open permissions: ugo+rw Jul 08 16:14:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:23 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da Jul 08 16:14:23 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:23 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:23 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info Jul 08 16:14:23 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:24 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info" returned: 0 in 0.670s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:24 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info is being set with open permissions: ugo+rw Jul 08 16:14:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:24 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info Jul 08 16:14:24 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:25 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.info" returned: 0 in 0.707s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.751s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:14:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-8c504fdd-a3b7-41f1-b68d-cfc51951106b req-13428f87-d228-40c5-83db-8886a0e034a9 tempest-VolumesSnapshotsTestJSON-112291989 None] Create snapshot completed successfully Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[475dfd0b-006f-4c9f-983a-2978295771ee]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:25 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb Jul 08 16:14:25 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:26 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb" returned: 0 in 1.352s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.384s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64eb2d9f-f285-40a1-9894-a3ffbdcc4a9a', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:14:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-df2da03d-fd82-48b8-b1c0-9906b92440e8 req-00c9cb71-e025-4297-a164-9a5ad57806c0 tempest-TaggedAttachmentsTest-1408214655 None] attachment_update completed successfully. Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "cinder-3521a338-0bff-45ca-9e1e-47c3679bd1da-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-3521a338-0bff-45ca-9e1e-47c3679bd1da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "cinder-quobyte-3521a338-0bff-45ca-9e1e-47c3679bd1da" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-3521a338-0bff-45ca-9e1e-47c3679bd1da" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Deleting offline snapshot 3521a338-0bff-45ca-9e1e-47c3679bd1da of volume a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] snapshot_file for this snap is: volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb7568b-8794-4303-bd63-27bf834a0724]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:27 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da Jul 08 16:14:27 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:28 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da" returned: 0 in 1.103s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0461063-05df-4b2d-96ed-7b34ba0318c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:14:28 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d95e7f-96c8-41b9-8989-eb2f945e2061]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:28 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 Jul 08 16:14:28 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:29 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0" returned: 0 in 0.803s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:29 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da Jul 08 16:14:29 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:30 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da" returned: 0 in 0.740s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:30 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da Jul 08 16:14:30 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:30 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0.3521a338-0bff-45ca-9e1e-47c3679bd1da" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-3521a338-0bff-45ca-9e1e-47c3679bd1da" released by "_delete_snapshot" :: held 3.690s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" released by "delete_snapshot" :: held 3.752s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:31 devstack cinder-volume[87227]: WARNING cinder.quota [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.quota [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Created reservations ['440eaf8c-780d-4216-9839-1cbdb75d915b', 'b109743d-5c05-4fce-9ccd-46ab080078e2', '16809ab8-e16a-4fa9-bdc1-773cf98985bc', 'bd824fd9-b279-4c69-a2f7-b1629ef7927c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Delete snapshot completed successfully. Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-104a3a68-a3f4-41fe-a4cc-56fa83ce3d8b req-20bd6282-37a4-4f3b-ac74-ad9ca08c62d9 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-3521a338-0bff-45ca-9e1e-47c3679bd1da-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "cinder-a0461063-05df-4b2d-96ed-7b34ba0318c0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-a0461063-05df-4b2d-96ed-7b34ba0318c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" acquired by "delete_volume" :: waited 0.037s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[84666d10-a451-4039-8a9a-69ad79476731]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:32 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 Jul 08 16:14:32 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:33 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0" returned: 0 in 1.107s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:33 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0 Jul 08 16:14:33 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:34 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a0461063-05df-4b2d-96ed-7b34ba0318c0" returned: 0 in 0.999s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-quobyte-a0461063-05df-4b2d-96ed-7b34ba0318c0" released by "delete_volume" :: held 2.219s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG cinder.quota [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Created reservations ['d0252e4f-31b8-412c-bf08-37270aaf1602', '050382cb-ad81-4f88-af49-8f5e25b0879f', '75d00abf-2630-4abb-9f94-fb99f823a527', '539697ad-6749-4bfb-b1ef-7493d5e2802f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:34 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:34 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-2e7bafc5-94da-43a0-ab18-cdd6102824cb req-9fbceac5-8fa2-4aba-a693-508c431bfa10 tempest-TaggedAttachmentsTest-1408214655 None] Terminate volume connection completed successfully. Jul 08 16:14:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-2e7bafc5-94da-43a0-ab18-cdd6102824cb req-9fbceac5-8fa2-4aba-a693-508c431bfa10 tempest-TaggedAttachmentsTest-1408214655 None] Deleting attachment 64eb2d9f-f285-40a1-9894-a3ffbdcc4a9a. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:14:35 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.867s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:35 devstack cinder-volume[87227]: DEBUG cinder.manager [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Deleted volume successfully. Jul 08 16:14:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-c2a8786d-67aa-4413-8f4e-ceea99ce8caa req-2e10b146-0e44-4eb7-a8b4-354c6c95fea5 tempest-VolumesSnapshotsTestJSON-112291989 None] Lock "cinder-a0461063-05df-4b2d-96ed-7b34ba0318c0-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Flow 'volume_create_manager' (e8356b12-3e7b-48f1-93ab-44c3b76e32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7498c5d-ee42-4a86-a3d1-934f7ff5bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7498c5d-ee42-4a86-a3d1-934f7ff5bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1512501229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9ef5d0-7ff8-4e73-b669-033d6d6fad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cfbd6ebdcc4a7ea957aa8b684264d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:38Z,use_quota=True,user_id='3ee1925c217846ba851f320dd1c8f1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c96ea12-c135-4d89-aa4b-1d343cc9d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c96ea12-c135-4d89-aa4b-1d343cc9d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50684388-c75f-43de-81dc-320784d120fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50684388-c75f-43de-81dc-320784d120fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9ef5d0-7ff8-4e73-b669-033d6d6fad64', 'volume_name': 'volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f197269-6d06-42fc-9db0-85a789693b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f197269-6d06-42fc-9db0-85a789693b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d776929-b132-4e7f-ba48-1b9dacf58fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Volume 0a9ef5d0-7ff8-4e73-b669-033d6d6fad64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64', 'volume_size': 1} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1512501229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9ef5d0-7ff8-4e73-b669-033d6d6fad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cfbd6ebdcc4a7ea957aa8b684264d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:38Z,use_quota=True,user_id='3ee1925c217846ba851f320dd1c8f1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Creating volume 0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:14:38 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:14:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:38 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 1073741824 Jul 08 16:14:38 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:39 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 1073741824" returned: 0 in 1.244s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:39 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 Jul 08 16:14:39 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:41 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" returned: 0 in 1.288s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.644s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d776929-b132-4e7f-ba48-1b9dacf58fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8ba54-f54d-4ce5-8823-136d805997b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Volume volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 (0a9ef5d0-7ff8-4e73-b669-033d6d6fad64): created successfully Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8ba54-f54d-4ce5-8823-136d805997b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Flow 'volume_create_manager' (e8356b12-3e7b-48f1-93ab-44c3b76e32d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-98df9b11-f9af-4051-a5b9-9c6341838ffd tempest-VolumesAdminNegativeTest-1210041014 None] Created volume successfully. Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Acquiring lock "cinder-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "cinder-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Acquiring lock "cinder-quobyte-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "cinder-quobyte-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a030683-485a-4a96-be12-2a4b879e3a80]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:43 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 Jul 08 16:14:43 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:44 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" returned: 0 in 1.283s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:44 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64 Jul 08 16:14:44 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:45 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" returned: 0 in 1.306s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "cinder-quobyte-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64" released by "delete_volume" :: held 2.651s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=37,cinder:UPDATE=41,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Created reservations ['efdc1468-c153-44b3-9adf-83ed944c9ddd', '73957115-d499-45db-b3d4-422f7c3c00a6', 'c981b3fd-825b-411c-b0b0-919337499654', 'e4ddab35-f169-4bfe-b9cc-bfe0e5581222'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:45 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:45 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:46 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.876s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:46 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Deleted volume successfully. Jul 08 16:14:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f70b757-d6a1-4b30-82ec-8ad562c846f3 tempest-VolumesAdminNegativeTest-1210041014 None] Lock "cinder-0a9ef5d0-7ff8-4e73-b669-033d6d6fad64-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ed36bd2e-411d-4e92-9836-b2c90cdb5628 tempest-GroupsTest-1205521679 None] Group tempest-Group1-37744423: creating Jul 08 16:14:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ed36bd2e-411d-4e92-9836-b2c90cdb5628 tempest-GroupsTest-1205521679 None] Group tempest-Group1-37744423: created successfully Jul 08 16:14:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ed36bd2e-411d-4e92-9836-b2c90cdb5628 tempest-GroupsTest-1205521679 None] Create group completed successfully. Jul 08 16:14:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2700409e-ea4e-48f4-9468-389ad1c7d0b5 tempest-GroupsTest-1205521679 None] Group tempest-Group2-1395993229: creating Jul 08 16:14:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2700409e-ea4e-48f4-9468-389ad1c7d0b5 tempest-GroupsTest-1205521679 None] Group tempest-Group2-1395993229: created successfully Jul 08 16:14:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2700409e-ea4e-48f4-9468-389ad1c7d0b5 tempest-GroupsTest-1205521679 None] Create group completed successfully. Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (269b02f4-8549-42da-bb64-38ef338f588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de0c05e-d7bd-4056-8bb6-a81d01ecaa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de0c05e-d7bd-4056-8bb6-a81d01ecaa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986506632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc6e716-cd2d-4330-83b0-28bf4a2301df,host='devstack@QuobyteHD#QuobyteHD',id=dbedcf42-0df8-4a8a-8d0e-82d4372c325a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:52Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fff4b2ab-8f39-4359-8405-220268a5c64f),volume_type_id=fff4b2ab-8f39-4359-8405-220268a5c64f)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a63908-ff70-4379-98f0-ae3016bd1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a63908-ff70-4379-98f0-ae3016bd1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1272a3-bbb9-4643-9d00-8af26969e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1272a3-bbb9-4643-9d00-8af26969e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbedcf42-0df8-4a8a-8d0e-82d4372c325a', 'volume_name': 'volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ae9052-3612-4073-8823-7dadb739dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ae9052-3612-4073-8823-7dadb739dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169bffe-0033-41fe-a8b0-1f5d46e126f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Volume dbedcf42-0df8-4a8a-8d0e-82d4372c325a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a', 'volume_size': 1} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ffc6e716-cd2d-4330-83b0-28bf4a2301df,created_at=2026-07-08T14:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986506632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc6e716-cd2d-4330-83b0-28bf4a2301df,host='devstack@QuobyteHD#QuobyteHD',id=dbedcf42-0df8-4a8a-8d0e-82d4372c325a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:14:52Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fff4b2ab-8f39-4359-8405-220268a5c64f),volume_type_id=fff4b2ab-8f39-4359-8405-220268a5c64f)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Creating volume dbedcf42-0df8-4a8a-8d0e-82d4372c325a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:14:52 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:14:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:52 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a 1073741824 Jul 08 16:14:52 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:53 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a 1073741824" returned: 0 in 0.944s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:53 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a Jul 08 16:14:53 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:54 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" returned: 0 in 0.668s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169bffe-0033-41fe-a8b0-1f5d46e126f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07821396-19d7-4bb6-9db2-9e1e7ea04109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:14:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Volume volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a (dbedcf42-0df8-4a8a-8d0e-82d4372c325a): created successfully Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07821396-19d7-4bb6-9db2-9e1e7ea04109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:14:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (269b02f4-8549-42da-bb64-38ef338f588a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:14:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5236865d-07c1-43b2-a951-a3d2beff8324 tempest-GroupsTest-1205521679 None] Created volume successfully. Jul 08 16:14:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Acquiring lock "cinder-quobyte-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbfb54f-d0e6-4dfe-a1e2-ae44d6db01c7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:55 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a Jul 08 16:14:55 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:56 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" returned: 0 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:56 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a Jul 08 16:14:56 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:57 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" returned: 0 in 0.811s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-dbedcf42-0df8-4a8a-8d0e-82d4372c325a" released by "delete_volume" :: held 1.793s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Created reservations ['62a3d03a-049c-45f4-9534-788bb8db662d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:57 devstack cinder-volume[87227]: WARNING cinder.quota [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-564372535 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-564372535, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:14:57 devstack cinder-volume[87227]: WARNING cinder.quota [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-564372535 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-564372535, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Created reservations ['457a33df-310b-4c78-8e4a-9534c1703133', 'c08cb132-6dc5-4de2-bfe2-2a3905266fe4', 'a0a788d0-ea18-4ccc-b8aa-38a6481175c3', 'd4336bba-cdfe-454d-9e82-9578ad49fd97'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:57 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:57 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "cinder-1bf6406a-d958-4039-a9b5-57e75bde1ecb-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "cinder-1bf6406a-d958-4039-a9b5-57e75bde1ecb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "cinder-quobyte-1bf6406a-d958-4039-a9b5-57e75bde1ecb" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "cinder-quobyte-1bf6406a-d958-4039-a9b5-57e75bde1ecb" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a3ada-7df6-4aec-bf17-9efaf4bd82c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:58 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb Jul 08 16:14:58 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Created reservations ['e4f37b8d-74eb-4eb1-a017-da3c2098166e'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:58 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:14:58 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:58 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.905s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:58 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6f8f4bd2-e47b-44f5-98ea-84f2c6bcb681 tempest-GroupsTest-1205521679 None] Delete group completed successfully. Jul 08 16:14:59 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb" returned: 0 in 0.909s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:14:59 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb Jul 08 16:14:59 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:14:59 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.788s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:14:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-788cc6f3-a125-4f94-9602-bdd0b336127e tempest-GroupsTest-1205521679 None] Delete group completed successfully. Jul 08 16:14:59 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1bf6406a-d958-4039-a9b5-57e75bde1ecb" returned: 0 in 0.814s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "cinder-quobyte-1bf6406a-d958-4039-a9b5-57e75bde1ecb" released by "delete_volume" :: held 1.779s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:14:59 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Created reservations ['35c06122-cf07-4199-b4c8-1f58d1e52548', 'a4ae7e4e-d541-4564-9834-b94066676070', '97e90d4c-11f9-4925-97d4-306ae7f1c97f', 'b31aaf51-934c-4f66-9ed3-554bc6cc1b4f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:15:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c4da1c8e-03e3-4034-b9af-c89e52e829b6 tempest-GroupsTest-1205521679 None] Group tempest-GroupsTest-Group-980396787: creating Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c4da1c8e-03e3-4034-b9af-c89e52e829b6 tempest-GroupsTest-1205521679 None] Group tempest-GroupsTest-Group-980396787: created successfully Jul 08 16:15:00 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:15:00 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c4da1c8e-03e3-4034-b9af-c89e52e829b6 tempest-GroupsTest-1205521679 None] Create group completed successfully. Jul 08 16:15:00 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.706s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:15:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Deleted volume successfully. Jul 08 16:15:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df064d05-65b7-4e46-88df-a1c6001cdcea tempest-TaggedAttachmentsTest-1408214655 None] Lock "cinder-1bf6406a-d958-4039-a9b5-57e75bde1ecb-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (3ef3b1d0-acad-4f50-9d00-7d322ab3ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03938fa1-6a9c-4a5a-b60a-1825f77625df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03938fa1-6a9c-4a5a-b60a-1825f77625df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367895964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,host='devstack@QuobyteHD#QuobyteHD',id=fef61f14-021e-4274-b54f-0aef2225efcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:02Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3),volume_type_id=18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0abb0d6-6eaa-42b2-a22c-b9047d08d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0abb0d6-6eaa-42b2-a22c-b9047d08d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75006eea-ea7d-4904-bdec-e574cfe39995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75006eea-ea7d-4904-bdec-e574cfe39995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef61f14-021e-4274-b54f-0aef2225efcd', 'volume_name': 'volume-fef61f14-021e-4274-b54f-0aef2225efcd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd657676-7049-4204-8490-e7e282af0697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd657676-7049-4204-8490-e7e282af0697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd65e11-b895-41a4-ae1c-244d931438f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Volume fef61f14-021e-4274-b54f-0aef2225efcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef61f14-021e-4274-b54f-0aef2225efcd', 'volume_size': 1} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,created_at=2026-07-08T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367895964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,host='devstack@QuobyteHD#QuobyteHD',id=fef61f14-021e-4274-b54f-0aef2225efcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:02Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3),volume_type_id=18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Creating volume fef61f14-021e-4274-b54f-0aef2225efcd {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:15:01 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:15:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:01 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd 1073741824 Jul 08 16:15:01 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:02 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd 1073741824" returned: 0 in 1.063s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:03 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd Jul 08 16:15:03 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:03 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd" returned: 0 in 0.974s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:15:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd65e11-b895-41a4-ae1c-244d931438f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef61f14-021e-4274-b54f-0aef2225efcd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f7c586-42c9-4bc1-b8ea-ff4bfe7e8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:04 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Volume volume-fef61f14-021e-4274-b54f-0aef2225efcd (fef61f14-021e-4274-b54f-0aef2225efcd): created successfully Jul 08 16:15:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f7c586-42c9-4bc1-b8ea-ff4bfe7e8739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (3ef3b1d0-acad-4f50-9d00-7d322ab3ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d44c91c4-b7fa-40ae-bf95-52e2bfe4fcf4 tempest-GroupsTest-1205521679 None] Created volume successfully. Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (d8c32578-32fa-4000-806b-30d94edffc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7696660a-270c-4fa8-97fb-b03a37c3be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7696660a-270c-4fa8-97fb-b03a37c3be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1133074255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,host='devstack@QuobyteHD#QuobyteHD',id=10263f6b-610c-489d-a456-ae3b15d0d8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:05Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3),volume_type_id=18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1167b38-e77a-405e-bf87-1895276d99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1167b38-e77a-405e-bf87-1895276d99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813166d5-2d7d-48c7-969f-45c299c5a258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813166d5-2d7d-48c7-969f-45c299c5a258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10263f6b-610c-489d-a456-ae3b15d0d8fd', 'volume_name': 'volume-10263f6b-610c-489d-a456-ae3b15d0d8fd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ebdc44-b0a7-492c-8452-8b871206c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ebdc44-b0a7-492c-8452-8b871206c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94ec06f-89c5-414e-b7e6-dbc98994c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Volume 10263f6b-610c-489d-a456-ae3b15d0d8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10263f6b-610c-489d-a456-ae3b15d0d8fd', 'volume_size': 1} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,created_at=2026-07-08T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1133074255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9bec8d-a1c3-4cab-ae7d-e09654fda100,host='devstack@QuobyteHD#QuobyteHD',id=10263f6b-610c-489d-a456-ae3b15d0d8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d28610be0484d46b8155e3d6da5d689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:05Z,use_quota=True,user_id='efa88769f6fb490985e9c5a49ce900e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3),volume_type_id=18a9cfe2-1dac-4e41-9f87-72f94a2eb7d3)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Creating volume 10263f6b-610c-489d-a456-ae3b15d0d8fd {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:15:05 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:15:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:05 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd 1073741824 Jul 08 16:15:05 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:06 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd 1073741824" returned: 0 in 0.915s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:06 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd Jul 08 16:15:06 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:06 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94ec06f-89c5-414e-b7e6-dbc98994c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10263f6b-610c-489d-a456-ae3b15d0d8fd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752b1a8f-0569-44ab-bbc5-4fce7340fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:06 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Volume volume-10263f6b-610c-489d-a456-ae3b15d0d8fd (10263f6b-610c-489d-a456-ae3b15d0d8fd): created successfully Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752b1a8f-0569-44ab-bbc5-4fce7340fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Flow 'volume_create_manager' (d8c32578-32fa-4000-806b-30d94edffc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9bfd6406-dc90-4083-a817-9d91cd71f689 tempest-GroupsTest-1205521679 None] Created volume successfully. Jul 08 16:15:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b7bebcd6-a4b3-46c9-92ce-ed8dd87a0d72 tempest-GroupsTest-1205521679 None] Update group completed successfully. Jul 08 16:15:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-626ec198-a819-4535-b01d-ecdad687e463 tempest-GroupsTest-1205521679 None] Update group completed successfully. Jul 08 16:15:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Acquiring lock "cinder-quobyte-10263f6b-610c-489d-a456-ae3b15d0d8fd" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-10263f6b-610c-489d-a456-ae3b15d0d8fd" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ddbfb-17cf-4cfb-bbd2-531b2a3032e9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:11 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd Jul 08 16:15:11 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:11 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:11 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd Jul 08 16:15:11 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:12 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-10263f6b-610c-489d-a456-ae3b15d0d8fd" returned: 0 in 0.660s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-10263f6b-610c-489d-a456-ae3b15d0d8fd" released by "delete_volume" :: held 1.579s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Acquiring lock "cinder-quobyte-fef61f14-021e-4274-b54f-0aef2225efcd" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-fef61f14-021e-4274-b54f-0aef2225efcd" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3624821-41c0-4160-8b21-13fc736c55ee]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:12 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd Jul 08 16:15:12 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:13 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd" returned: 0 in 0.922s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:13 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd Jul 08 16:15:13 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:14 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fef61f14-021e-4274-b54f-0aef2225efcd" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "cinder-quobyte-fef61f14-021e-4274-b54f-0aef2225efcd" released by "delete_volume" :: held 1.743s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Created reservations ['a1ebbf71-d393-4fe9-8b1d-7b14cf59b9d5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:15:14 devstack cinder-volume[87227]: WARNING cinder.quota [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1314441479 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1314441479, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:15:14 devstack cinder-volume[87227]: WARNING cinder.quota [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1314441479 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1314441479, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Created reservations ['fed0d445-e7d5-4bb1-869a-25aa4acc5066', '36323fb2-2a8d-4163-b976-fb343de920a6', '38321982-102f-49f1-b08f-b694eede6330', '53d1fcc0-b6e8-446a-bf8f-df42659587d8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Created reservations ['c7ecdd38-a1de-402e-877b-ff4687fe02bd', '4355b2e4-ed3b-456d-93dd-922604e8ecfd', '90dbe1ad-25a9-4566-945f-0cd9632e3c38', '3b220f0e-c54a-4e6f-8125-8f822d9304c9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:14 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:15:14 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:15 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:15 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:15:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1c2b95e0-38a3-425b-98a9-01882a133879 tempest-GroupsTest-1205521679 None] Delete group completed successfully. Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:19 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:15:19 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:20 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:15:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:15:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 8 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:15:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:15:24 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=47,cinder:INSERT=13,cinder:UPDATE=58,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:15:24 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=77,cinder:UPDATE=78,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:15:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-454dc1ac-c582-45cc-9b97-290e0fb4abbb tempest-GroupsV314Test-1882952185 None] Group tempest-GroupsV314Test-Group-1956137019: creating Jul 08 16:15:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-454dc1ac-c582-45cc-9b97-290e0fb4abbb tempest-GroupsV314Test-1882952185 None] Group tempest-GroupsV314Test-Group-1956137019: created successfully Jul 08 16:15:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-454dc1ac-c582-45cc-9b97-290e0fb4abbb tempest-GroupsV314Test-1882952185 None] Create group completed successfully. Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Flow 'volume_create_manager' (0667c7c9-30e1-4235-9db4-12f7d703bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e0e1e-da29-4874-980d-616362d3ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e0e1e-da29-4874-980d-616362d3ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-997153188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d4cdc1-7e01-45ee-9a2c-f13397a1becc,host='devstack@QuobyteHD#QuobyteHD',id=5066d017-8b28-4fa0-a2fa-2a7b1491514b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb811ff7d4c76b5097a7bacf7cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:30Z,use_quota=True,user_id='7b3c56e2982144fb9cc06994bb26e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60b60b7b-6ff9-46ac-8b8d-129d431609ad),volume_type_id=60b60b7b-6ff9-46ac-8b8d-129d431609ad)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6207fa-34a2-4caf-bce1-031b17c8081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6207fa-34a2-4caf-bce1-031b17c8081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed1dfc0-9e41-4112-a4f5-51a1ee512cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed1dfc0-9e41-4112-a4f5-51a1ee512cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5066d017-8b28-4fa0-a2fa-2a7b1491514b', 'volume_name': 'volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666a2fb1-ba9f-46db-9002-288db469c786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666a2fb1-ba9f-46db-9002-288db469c786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34557a0-38d2-469a-a5ca-c5faa9f35e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Volume 5066d017-8b28-4fa0-a2fa-2a7b1491514b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b', 'volume_size': 1} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22d4cdc1-7e01-45ee-9a2c-f13397a1becc,created_at=2026-07-08T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-997153188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d4cdc1-7e01-45ee-9a2c-f13397a1becc,host='devstack@QuobyteHD#QuobyteHD',id=5066d017-8b28-4fa0-a2fa-2a7b1491514b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb811ff7d4c76b5097a7bacf7cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:15:30Z,use_quota=True,user_id='7b3c56e2982144fb9cc06994bb26e5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60b60b7b-6ff9-46ac-8b8d-129d431609ad),volume_type_id=60b60b7b-6ff9-46ac-8b8d-129d431609ad)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Creating volume 5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:15:29 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Acquiring lock "cinder-5e1cac50-4d90-45a9-bf45-c15c9e772676-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:29 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b 1073741824 Jul 08 16:15:29 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "cinder-5e1cac50-4d90-45a9-bf45-c15c9e772676-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Acquiring lock "cinder-quobyte-5e1cac50-4d90-45a9-bf45-c15c9e772676" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "cinder-quobyte-5e1cac50-4d90-45a9-bf45-c15c9e772676" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cbcf4b-0c30-48db-b81d-7ae8a8946b78]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:30 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 Jul 08 16:15:30 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:30 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b 1073741824" returned: 0 in 0.973s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:30 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676" returned: 0 in 0.903s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:31 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:15:31 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:31 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676 Jul 08 16:15:31 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:31 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5e1cac50-4d90-45a9-bf45-c15c9e772676" returned: 0 in 0.721s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:31 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "cinder-quobyte-5e1cac50-4d90-45a9-bf45-c15c9e772676" released by "delete_volume" :: held 1.680s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34557a0-38d2-469a-a5ca-c5faa9f35e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052d5b45-2dc8-4fcd-9e8e-f3d4ef95a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Volume volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b (5066d017-8b28-4fa0-a2fa-2a7b1491514b): created successfully Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052d5b45-2dc8-4fcd-9e8e-f3d4ef95a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Flow 'volume_create_manager' (0667c7c9-30e1-4235-9db4-12f7d703bb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-161d5cdb-27fd-400b-8c4f-f3d2f8de0518 tempest-GroupsV314Test-1882952185 None] Created volume successfully. Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Created reservations ['a2892c45-2b63-4f86-b90e-afc53e2b561a', '33025c2b-f986-4a3d-9964-d94a951abebc', 'b7eb9d92-df6c-4104-894b-2d65f8e3a7ef', '06b726e3-50de-46e5-9aff-b0c309f4eb25'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:31 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:15:31 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:32 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:32 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:15:32 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Deleted volume successfully. Jul 08 16:15:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c7b6411-e308-4b52-ad3f-b5247ec6eccd tempest-AttachVolumeShelveTestJSON-354937171 None] Lock "cinder-5e1cac50-4d90-45a9-bf45-c15c9e772676-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:33 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Cloning volume 5066d017-8b28-4fa0-a2fa-2a7b1491514b to volume 2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 Jul 08 16:15:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Creating offline snapshot bba51e58-2cf3-4cf8-a39f-cf38efeb755e of volume 5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:15:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa6016-fdc3-465c-86ed-af215320f0e0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:33 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:15:33 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:35 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 1.248s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:35 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e 1G Jul 08 16:15:35 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:36 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e 1G" returned: 0 in 1.067s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:36 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:36 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:36 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 0.911s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:36 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:15:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:37 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:37 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:37 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 0.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:37 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info Jul 08 16:15:37 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:38 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info" returned: 0 in 0.811s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:38 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:15:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:38 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info Jul 08 16:15:38 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:39 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.info" returned: 0 in 1.193s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Acquiring lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] snapshot: bba51e58-2cf3-4cf8-a39f-cf38efeb755e, volume: 2eb1e5e1-35b2-4864-aca2-e6b486cf54a1, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7219bc9-aaec-4a89-96e7-e6cd8834fee3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:40 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:40 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:41 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 1.448s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e465772-b877-4500-a744-a67d0935e5c7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:41 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:15:41 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:42 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 1.046s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:42 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:15:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:42 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 Jul 08 16:15:42 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-702eef44-4780-4a1c-946b-dc563dec8bf2 tempest-BackendsCapabilitiesAdminTestsJSON-1188250005 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940689086914, 'free_capacity_gb': 1775.6940689086914, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87227) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 16:15:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-40178ba1-872d-4ba8-bc81-f651329c60cf tempest-BackendsCapabilitiesAdminTestsJSON-1188250005 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940689086914, 'free_capacity_gb': 1775.6940689086914, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87227) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 16:15:47 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:15:47 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:15:52 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" returned: 0 in 10.190s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ed930-c704-49f5-97f5-abb097b62d00]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:52 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:15:52 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:54 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 1.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:54 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:15:54 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Converted 1024.00 MB image at 100.47 MB/s Jul 08 16:15:54 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:15:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:54 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 Jul 08 16:15:54 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:55 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" returned: 0 in 1.286s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" released by "_copy_volume_from_snapshot" :: held 15.774s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Acquiring lock "cinder-quobyte-bba51e58-2cf3-4cf8-a39f-cf38efeb755e" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-bba51e58-2cf3-4cf8-a39f-cf38efeb755e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Deleting offline snapshot bba51e58-2cf3-4cf8-a39f-cf38efeb755e of volume 5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] snapshot_file for this snap is: volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501a578-7c0b-4a85-b0c4-8db894c71d86]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:56 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:56 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:56 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 1.139s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:15:57 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8b8994-e848-4afe-a886-9c69608a4e6c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:15:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:57 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:15:57 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fb580c74-fd72-455a-b72b-34cc25d26763 tempest-GroupSnapshotsV319Test-486703306 None] Group tempest-GroupSnapshotsV319Test-Group-503696813: creating Jul 08 16:15:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fb580c74-fd72-455a-b72b-34cc25d26763 tempest-GroupSnapshotsV319Test-486703306 None] Group tempest-GroupSnapshotsV319Test-Group-503696813: created successfully Jul 08 16:15:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fb580c74-fd72-455a-b72b-34cc25d26763 tempest-GroupSnapshotsV319Test-486703306 None] Create group completed successfully. Jul 08 16:15:58 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 1.064s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:58 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:58 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:58 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:58 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e Jul 08 16:15:58 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:59 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b.bba51e58-2cf3-4cf8-a39f-cf38efeb755e" returned: 0 in 0.735s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-bba51e58-2cf3-4cf8-a39f-cf38efeb755e" released by "_delete_snapshot" :: held 3.901s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.052s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Flow 'volume_create_manager' (e07a7808-4d78-4d00-b2e2-d526624d483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8526b6d1-f057-4635-a7f2-211fd1bd8dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8526b6d1-f057-4635-a7f2-211fd1bd8dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555309023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8fa6d2d-c24a-4fd9-a368-2186ab514f62,host='devstack@QuobyteHD#QuobyteHD',id=b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e872603cad4b0a8a01c1772b18991e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:00Z,use_quota=True,user_id='c1a839a4640b4ec1a81e0f282e5894c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c4b9bd9-d622-4629-8c38-4a5bb9f94202),volume_type_id=8c4b9bd9-d622-4629-8c38-4a5bb9f94202)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a562e2-6c10-4201-be49-3ad2c7137d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a562e2-6c10-4201-be49-3ad2c7137d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cf71c-5fcd-4274-b38c-7423580fcff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cf71c-5fcd-4274-b38c-7423580fcff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07', 'volume_name': 'volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb84234a-bec2-46b2-bd90-50349549b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb84234a-bec2-46b2-bd90-50349549b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f48ed1-1aed-4a8f-821f-4cc6c132eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:15:59 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Volume b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07', 'volume_size': 1} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8fa6d2d-c24a-4fd9-a368-2186ab514f62,created_at=2026-07-08T14:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555309023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8fa6d2d-c24a-4fd9-a368-2186ab514f62,host='devstack@QuobyteHD#QuobyteHD',id=b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e872603cad4b0a8a01c1772b18991e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:00Z,use_quota=True,user_id='c1a839a4640b4ec1a81e0f282e5894c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c4b9bd9-d622-4629-8c38-4a5bb9f94202),volume_type_id=8c4b9bd9-d622-4629-8c38-4a5bb9f94202)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Creating volume b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:15:59 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:15:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:15:59 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 1073741824 Jul 08 16:15:59 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:15:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-06b50805-e2e8-4c92-9657-841a4aae1e6c tempest-GroupsV314Test-1882952185 None] Create group from source-group-22d4cdc1-7e01-45ee-9a2c-f13397a1becc completed successfully. Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Acquiring lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab660b-0ca7-4491-b70d-a346cc03df64]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:00 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 Jul 08 16:16:00 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:00 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 1073741824" returned: 0 in 1.010s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:00 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 Jul 08 16:16:00 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:01 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" returned: 0 in 0.873s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:01 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1 Jul 08 16:16:01 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:01 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f48ed1-1aed-4a8f-821f-4cc6c132eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e2fddd-4d6e-4434-8ce9-c1252b7a03bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Volume volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 (b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07): created successfully Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e2fddd-4d6e-4434-8ce9-c1252b7a03bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Flow 'volume_create_manager' (e07a7808-4d78-4d00-b2e2-d526624d483d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fc9a96fc-5254-417e-9cbb-83b50a59f9e4 tempest-GroupSnapshotsV319Test-486703306 None] Created volume successfully. Jul 08 16:16:01 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" returned: 0 in 0.722s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-2eb1e5e1-35b2-4864-aca2-e6b486cf54a1" released by "delete_volume" :: held 1.662s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Created reservations ['718c7046-3323-4bf6-9aea-12bfe616b8e4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:02 devstack cinder-volume[87227]: WARNING cinder.quota [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1922669963 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1922669963, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:16:02 devstack cinder-volume[87227]: WARNING cinder.quota [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1922669963 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1922669963, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Created reservations ['558d5feb-5465-474f-818d-ad514b443d77', 'c12acdb5-9121-46c6-9c80-39191d516d06', 'f3840d7e-7873-4e9e-8f8e-cfeebf72b0bc', '58d587be-26f2-4286-88cd-41ccc023af9a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] GroupSnapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: creating. Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Group snapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: creating. {{(pid=87227) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Creating offline snapshot c5b8353d-6ec7-4f8b-b259-703239597a4d of volume b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:16:02 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:02 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cd7e44-81c0-4c32-8b98-9b2fa2522e13]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:02 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 Jul 08 16:16:02 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:03 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.871s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-59c9dea7-5ad1-4f96-913e-10107b783e65 tempest-GroupsV314Test-1882952185 None] Delete group completed successfully. Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Acquiring lock "cinder-quobyte-5066d017-8b28-4fa0-a2fa-2a7b1491514b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-5066d017-8b28-4fa0-a2fa-2a7b1491514b" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3efa5-c833-44c7-b29e-ddbd769fe6f9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:03 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:16:03 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:03 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" returned: 0 in 1.169s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:03 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d 1G Jul 08 16:16:03 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:04 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 0.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:04 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b Jul 08 16:16:04 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:04 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d 1G" returned: 0 in 0.965s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:04 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d Jul 08 16:16:04 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:04 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5066d017-8b28-4fa0-a2fa-2a7b1491514b" returned: 0 in 0.746s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Lock "cinder-quobyte-5066d017-8b28-4fa0-a2fa-2a7b1491514b" released by "delete_volume" :: held 1.715s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Created reservations ['cd1ac220-9dec-4269-be11-005afd60af3d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Created reservations ['a1f32790-173d-44c5-bc77-6e4cd427a62c', '6e97b570-08fc-430a-8969-99dc18735145', '32a416c5-653b-4d24-b241-9cd68dce49ed', '290277d4-ba1c-4830-bd05-668e82ec31fb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:05 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:05 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:05 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d" returned: 0 in 0.791s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:05 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:16:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:05 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d Jul 08 16:16:05 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:06 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d" returned: 0 in 0.815s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (3c6b1cf7-ac80-4720-ac69-e3459c8c2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523aabc-6252-420d-a15c-435714ac282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523aabc-6252-420d-a15c-435714ac282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-763735340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c18c1-a638-4d44-9c58-375e5c039d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:06Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:06 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c90634e-25bb-4e63-964f-a9fc8bb3dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:06 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info Jul 08 16:16:06 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c90634e-25bb-4e63-964f-a9fc8bb3dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06130a88-4739-46bc-b12e-53632a2faafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06130a88-4739-46bc-b12e-53632a2faafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441c18c1-a638-4d44-9c58-375e5c039d0f', 'volume_name': 'volume-441c18c1-a638-4d44-9c58-375e5c039d0f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abd499e-f8db-4741-bfa8-aacc72ac7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abd499e-f8db-4741-bfa8-aacc72ac7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea090e9-dc23-455b-b3c6-3b8d37947e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:06 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Volume 441c18c1-a638-4d44-9c58-375e5c039d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441c18c1-a638-4d44-9c58-375e5c039d0f', 'volume_size': 1} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.080s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1c667d9d-aa91-4e93-8379-90d9da04d5f9 tempest-GroupsV314Test-1882952185 None] Delete group completed successfully. Jul 08 16:16:06 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info" returned: 0 in 0.683s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:06 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:16:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:06 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info Jul 08 16:16:06 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:07 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.info" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.303s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-763735340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c18c1-a638-4d44-9c58-375e5c039d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:06Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Creating volume 441c18c1-a638-4d44-9c58-375e5c039d0f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:16:07 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:16:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:07 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f 1073741824 Jul 08 16:16:07 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f2875db9-9585-4ca4-83ea-4185686ff442 tempest-GroupSnapshotsV319Test-486703306 None] group_snapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: created successfully Jul 08 16:16:08 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f 1073741824" returned: 0 in 0.901s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:08 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f Jul 08 16:16:08 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] group_snapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: deleting Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] group_snapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: deleting {{(pid=87227) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "cinder-quobyte-c5b8353d-6ec7-4f8b-b259-703239597a4d" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-c5b8353d-6ec7-4f8b-b259-703239597a4d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Deleting offline snapshot c5b8353d-6ec7-4f8b-b259-703239597a4d of volume b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] snapshot_file for this snap is: volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5ea55-df99-4b15-bbd2-0c866f7ab640]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:09 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f" returned: 0 in 0.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea090e9-dc23-455b-b3c6-3b8d37947e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441c18c1-a638-4d44-9c58-375e5c039d0f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3844dba-7ada-4685-851d-08d5c15e520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:09 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Volume volume-441c18c1-a638-4d44-9c58-375e5c039d0f (441c18c1-a638-4d44-9c58-375e5c039d0f): created successfully Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3844dba-7ada-4685-851d-08d5c15e520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (3c6b1cf7-ac80-4720-ac69-e3459c8c2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-072d9842-1385-40c8-92a4-9e92ed2730d3 tempest-AttachVolumeNegativeTest-2005293778 None] Created volume successfully. Jul 08 16:16:09 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d Jul 08 16:16:09 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:10 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d" returned: 0 in 0.813s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:16:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87219f4-edcc-4c26-8d61-91b42a75b05e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:10 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 Jul 08 16:16:10 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:11 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" returned: 0 in 0.925s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:11 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d Jul 08 16:16:11 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:11 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d" returned: 0 in 0.794s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:11 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d Jul 08 16:16:11 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:12 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07.c5b8353d-6ec7-4f8b-b259-703239597a4d" returned: 0 in 0.659s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-c5b8353d-6ec7-4f8b-b259-703239597a4d" released by "_delete_snapshot" :: held 3.315s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" released by "delete_snapshot" :: held 3.345s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:12 devstack cinder-volume[87227]: WARNING cinder.quota [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1230644645 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1230644645, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:16:12 devstack cinder-volume[87227]: WARNING cinder.quota [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1230644645 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1230644645, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:16:12 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] Created reservations ['e1eb4bba-67a6-44ba-a015-791408e4cd23', 'befbe0e2-f316-4c8e-8cbb-65bc2f77d1c0', '491764a9-2d0c-476c-b680-91fa2661fd4b', '97c4da05-cf76-4fad-83a4-f12e4a4d89ef'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bf511cd2-b505-422f-9456-8e92863953b0 tempest-GroupSnapshotsV319Test-486703306 None] group_snapshot 45d8ed20-d785-47c0-8eda-ef6a2882e731: deleted successfully Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[894c1f88-02d5-4e9d-af81-c2d0f39d1117]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:13 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f Jul 08 16:16:13 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4d05f-0f7a-43e8-844a-c1ad4edc3c4b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:14 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 Jul 08 16:16:14 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:14 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-441c18c1-a638-4d44-9c58-375e5c039d0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95e16f8a-0942-48af-8c63-7912b8ea0d37', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:16:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-4ffd4c8c-2cff-4bdb-81d7-d3f6e436254f req-c43f7996-c393-40da-bb57-38423f7350e4 tempest-AttachVolumeNegativeTest-2005293778 None] attachment_update completed successfully. Jul 08 16:16:14 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" returned: 0 in 0.846s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:14 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07 Jul 08 16:16:14 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:15 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" returned: 0 in 0.696s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Lock "cinder-quobyte-b4a735bb-74cc-45cb-8dc9-0ae9bb4e9a07" released by "delete_volume" :: held 1.609s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Created reservations ['11635e4b-1577-44f8-a669-74b37bebc076'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:15 devstack cinder-volume[87227]: WARNING cinder.quota [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1230644645 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1230644645, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Created reservations ['2d48174d-9a73-47ba-908d-59722c91400b', 'ec67cb92-cc10-4801-bcbb-68d569ae4d0b', 'f73e59f1-b0b4-476a-9288-99ebc351df75', 'c2017c1f-27a5-41b5-8600-ac211af730f9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:15 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:15 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:16 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.712s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cd3fa234-616e-4797-9ff7-64c2bf19833a tempest-GroupSnapshotsV319Test-486703306 None] Delete group completed successfully. Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Flow 'volume_create_manager' (55147e72-8ab9-4639-9f6a-e44b17a26a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fba501-153b-44b8-bc3a-377166ed9165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fba501-153b-44b8-bc3a-377166ed9165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-887621681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608fa0f5-3f6c-4dfa-bf93-2a749b78de79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93219949eacd4d0a96e084ae848f0a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:18Z,use_quota=True,user_id='a3a835337a7f4afb9ef29656f260f6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6e9223-6c00-441b-8895-827ea7f2b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6e9223-6c00-441b-8895-827ea7f2b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0e7ad2-81b0-4045-b937-2e79086cacf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0e7ad2-81b0-4045-b937-2e79086cacf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'volume_name': 'volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f8101-b30d-4c67-94fe-b32a984d2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f8101-b30d-4c67-94fe-b32a984d2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f6197f-d547-4a52-b2e4-3cbf324324e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Volume 608fa0f5-3f6c-4dfa-bf93-2a749b78de79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'volume_size': 1} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-887621681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608fa0f5-3f6c-4dfa-bf93-2a749b78de79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93219949eacd4d0a96e084ae848f0a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:18Z,use_quota=True,user_id='a3a835337a7f4afb9ef29656f260f6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Creating volume 608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:16:17 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:16:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:17 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 1073741824 Jul 08 16:16:17 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:18 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 1073741824" returned: 0 in 1.136s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:18 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 Jul 08 16:16:18 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:19 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:19 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:19 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" returned: 0 in 1.055s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f6197f-d547-4a52-b2e4-3cbf324324e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f954074-ce05-45b1-a952-d299d6b1ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:20 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Volume volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 (608fa0f5-3f6c-4dfa-bf93-2a749b78de79): created successfully Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f954074-ce05-45b1-a952-d299d6b1ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Flow 'volume_create_manager' (55147e72-8ab9-4639-9f6a-e44b17a26a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e0834df8-9d93-4795-bb0a-e5cc24d9c203 tempest-ServerActionsTestOtherA-368961541 None] Created volume successfully. Jul 08 16:16:20 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.915s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 8 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:16:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Flow 'volume_create_manager' (a52d9ce5-b9af-4c54-ac93-78c8f4c4c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fc9d7-613d-4e6a-a643-670348acfde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fc9d7-613d-4e6a-a643-670348acfde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-428403333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9052d86-2472-46ae-8449-3dfe3c171c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ac024594b47bcf7c6cf9551da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:27Z,use_quota=True,user_id='bbe97a842fb0481b8467e188706009fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4cdd5-13c6-4560-ac03-85a70b49535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4cdd5-13c6-4560-ac03-85a70b49535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa6a8a-0396-4a02-81eb-67dc70efc5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa6a8a-0396-4a02-81eb-67dc70efc5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9052d86-2472-46ae-8449-3dfe3c171c70', 'volume_name': 'volume-d9052d86-2472-46ae-8449-3dfe3c171c70', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6105fd7b-4db5-448c-81ea-d85a399bf08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6105fd7b-4db5-448c-81ea-d85a399bf08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f453e52-479e-498f-b910-208243ceade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:27 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Volume d9052d86-2472-46ae-8449-3dfe3c171c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9052d86-2472-46ae-8449-3dfe3c171c70', 'volume_size': 1} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-428403333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9052d86-2472-46ae-8449-3dfe3c171c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ac024594b47bcf7c6cf9551da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:27Z,use_quota=True,user_id='bbe97a842fb0481b8467e188706009fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Creating volume d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:16:27 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:16:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:27 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 1073741824 Jul 08 16:16:27 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:28 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 1073741824" returned: 0 in 1.158s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:28 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 Jul 08 16:16:28 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:29 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70" returned: 0 in 0.753s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f453e52-479e-498f-b910-208243ceade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9052d86-2472-46ae-8449-3dfe3c171c70', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ee229-000d-4bdd-ae52-cb1ef0489b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Volume volume-d9052d86-2472-46ae-8449-3dfe3c171c70 (d9052d86-2472-46ae-8449-3dfe3c171c70): created successfully Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ee229-000d-4bdd-ae52-cb1ef0489b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Flow 'volume_create_manager' (a52d9ce5-b9af-4c54-ac93-78c8f4c4c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bc4fa5c2-a14d-459a-9038-a549a1402e4f tempest-SnapshotMetadataTestJSON-1387043821 None] Created volume successfully. Jul 08 16:16:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Creating offline snapshot 1c8d87a3-5698-42b7-9d14-1feaddaad1b8 of volume d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:16:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e55a75-3cfe-40bd-8c5a-00725214ce6b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:31 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 Jul 08 16:16:31 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:31 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70" returned: 0 in 0.903s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:31 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 1G Jul 08 16:16:31 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:32 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 1G" returned: 0 in 1.015s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9052d86-2472-46ae-8449-3dfe3c171c70 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:32 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9052d86-2472-46ae-8449-3dfe3c171c70 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 Jul 08 16:16:32 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:33 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9052d86-2472-46ae-8449-3dfe3c171c70 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8" returned: 0 in 0.895s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:33 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 is being set with open permissions: ugo+rw Jul 08 16:16:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:33 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 Jul 08 16:16:33 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:34 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8" returned: 0 in 0.836s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:34 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info Jul 08 16:16:34 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:35 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info" returned: 0 in 0.718s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:35 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info is being set with open permissions: ugo+rw Jul 08 16:16:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:35 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info Jul 08 16:16:35 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:36 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.info" returned: 0 in 1.033s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.510s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:36 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-58b232bf-c198-4312-a48a-f292a84bef6c tempest-SnapshotMetadataTestJSON-1387043821 None] Create snapshot completed successfully Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "cinder-1c8d87a3-5698-42b7-9d14-1feaddaad1b8-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-1c8d87a3-5698-42b7-9d14-1feaddaad1b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "cinder-quobyte-1c8d87a3-5698-42b7-9d14-1feaddaad1b8" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-1c8d87a3-5698-42b7-9d14-1feaddaad1b8" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Deleting offline snapshot 1c8d87a3-5698-42b7-9d14-1feaddaad1b8 of volume d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] snapshot_file for this snap is: volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547f15b-d847-4a88-93f7-11c4e36ba797]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:38 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 Jul 08 16:16:38 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:40 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8" returned: 0 in 1.607s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9052d86-2472-46ae-8449-3dfe3c171c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde118f-36ed-42ec-a87d-d786fc4e9ec9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Flow 'volume_create_manager' (ec835d19-9ac1-4bea-a20b-d71ab85e2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94499a63-e4c0-4b86-bd81-f76e2b1490cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94499a63-e4c0-4b86-bd81-f76e2b1490cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1245864517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e263dca5-ad09-4943-b00d-1d0399f285d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efee3eaba97426eaf6adbcd60688a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:40Z,use_quota=True,user_id='1595df745cbe46fe86db227785da8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a74c8a-8b13-4c26-97fc-9623a06074ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a74c8a-8b13-4c26-97fc-9623a06074ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92953290-1403-4aab-ba29-3db02284dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92953290-1403-4aab-ba29-3db02284dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e263dca5-ad09-4943-b00d-1d0399f285d7', 'volume_name': 'volume-e263dca5-ad09-4943-b00d-1d0399f285d7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9709b5-597a-40f7-b18a-38d3166f8587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9709b5-597a-40f7-b18a-38d3166f8587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56c4fae-4d0b-4d0e-8836-b6f0a9255c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:40 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Volume e263dca5-ad09-4943-b00d-1d0399f285d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e263dca5-ad09-4943-b00d-1d0399f285d7', 'volume_size': 1} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1245864517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e263dca5-ad09-4943-b00d-1d0399f285d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efee3eaba97426eaf6adbcd60688a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:40Z,use_quota=True,user_id='1595df745cbe46fe86db227785da8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Creating volume e263dca5-ad09-4943-b00d-1d0399f285d7 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:16:40 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:16:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:40 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 Jul 08 16:16:40 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:40 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 1073741824 Jul 08 16:16:40 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:41 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70" returned: 0 in 1.384s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:41 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 Jul 08 16:16:41 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:42 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 1073741824" returned: 0 in 1.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:42 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 Jul 08 16:16:42 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:43 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8" returned: 0 in 1.400s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:43 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8 Jul 08 16:16:43 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:44 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7" returned: 0 in 1.626s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] <== create_volume: return (3569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.573s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56c4fae-4d0b-4d0e-8836-b6f0a9255c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e263dca5-ad09-4943-b00d-1d0399f285d7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1d7567-260d-4c9b-9395-cdc8f646ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:44 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Volume volume-e263dca5-ad09-4943-b00d-1d0399f285d7 (e263dca5-ad09-4943-b00d-1d0399f285d7): created successfully Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1d7567-260d-4c9b-9395-cdc8f646ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Flow 'volume_create_manager' (ec835d19-9ac1-4bea-a20b-d71ab85e2565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-86f2d11c-0f71-4657-9b01-24dbdc7ffbe0 tempest-VolumesServicesTestJSON-306457688 None] Created volume successfully. Jul 08 16:16:44 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70.1c8d87a3-5698-42b7-9d14-1feaddaad1b8" returned: 0 in 1.302s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-1c8d87a3-5698-42b7-9d14-1feaddaad1b8" released by "_delete_snapshot" :: held 5.868s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" released by "delete_snapshot" :: held 5.930s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Created reservations ['d49cdb67-4caa-4380-a8f2-cd5dfb7d1e13', '2da4ef5c-94db-4ad3-98b2-519f01c03d26', '64cd6e05-a5e2-4fc5-a0f4-08b43fb3e98c', 'cfa2e7a0-10aa-4582-a76b-a1de8133b82b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Delete snapshot completed successfully. Jul 08 16:16:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b4a6bc74-c83f-4e43-ba87-5faa38b151a8 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-1c8d87a3-5698-42b7-9d14-1feaddaad1b8-delete_snapshot" released by "delete_snapshot" :: held 6.099s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Acquiring lock "cinder-e263dca5-ad09-4943-b00d-1d0399f285d7-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "cinder-e263dca5-ad09-4943-b00d-1d0399f285d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "cinder-d9052d86-2472-46ae-8449-3dfe3c171c70-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Acquiring lock "cinder-quobyte-e263dca5-ad09-4943-b00d-1d0399f285d7" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "cinder-quobyte-e263dca5-ad09-4943-b00d-1d0399f285d7" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486680d-eacf-4f33-9f9b-b2bdc7d32b34]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-d9052d86-2472-46ae-8449-3dfe3c171c70-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe1cfb7-23e3-4f82-b7a5-6c15131dbbcc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:16:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:45 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 Jul 08 16:16:45 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:45 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 Jul 08 16:16:45 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:46 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7" returned: 0 in 1.000s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:46 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7 Jul 08 16:16:46 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:46 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70" returned: 0 in 0.936s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:46 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70 Jul 08 16:16:46 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:47 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e263dca5-ad09-4943-b00d-1d0399f285d7" returned: 0 in 0.809s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "cinder-quobyte-e263dca5-ad09-4943-b00d-1d0399f285d7" released by "delete_volume" :: held 1.879s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Created reservations ['f6e0646b-d37c-446b-9dac-c87547e476dd', '3da107de-0a36-4322-9bb5-911f34e7e285', '0bbd5d7e-a494-42b4-bdf4-6ab021850698', '309a57a9-06bf-4626-8bba-10122427a48f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:47 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d9052d86-2472-46ae-8449-3dfe3c171c70" returned: 0 in 0.937s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:47 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:47 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-quobyte-d9052d86-2472-46ae-8449-3dfe3c171c70" released by "delete_volume" :: held 1.967s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Created reservations ['cd284343-a819-43e0-b61d-405646739c98', '2d0afb19-683d-4524-8884-3838a4416278', '6953fb4b-df55-4070-a732-b64fc5165a15', 'f2c11c1f-1b02-4879-b334-1ddee8bd15e4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:47 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:16:47 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:48 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:48 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Deleted volume successfully. Jul 08 16:16:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5d7dbee3-11b6-42d8-8d20-d8ad6e2b0880 tempest-VolumesServicesTestJSON-306457688 None] Lock "cinder-e263dca5-ad09-4943-b00d-1d0399f285d7-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:48 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.089s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:48 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:16:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Deleted volume successfully. Jul 08 16:16:49 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=84,cinder:SELECT=67,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:16:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a0406ff5-7dc8-4955-8efe-5e57b7bcfaf3 tempest-SnapshotMetadataTestJSON-1387043821 None] Lock "cinder-d9052d86-2472-46ae-8449-3dfe3c171c70-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Flow 'volume_create_manager' (ae180054-5f40-4969-af04-2216682b6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eaa01a-0c7c-4f4c-9271-02174e9fd530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eaa01a-0c7c-4f4c-9271-02174e9fd530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-746387852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e6d0c6-4166-4237-967a-40091279dac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0520a3ced17f4eccb25023cd8223ad8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:57Z,use_quota=True,user_id='bcfac1123a3345ac917ac99ab456c508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e474cbb-b397-45ae-89a5-ec7b20ad3363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e474cbb-b397-45ae-89a5-ec7b20ad3363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4176aac1-4163-4435-a820-ef7c3aaaf20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4176aac1-4163-4435-a820-ef7c3aaaf20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e6d0c6-4166-4237-967a-40091279dac4', 'volume_name': 'volume-33e6d0c6-4166-4237-967a-40091279dac4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b4e3c4-8901-4561-b822-13462236851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b4e3c4-8901-4561-b822-13462236851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cf4504-72aa-43e2-9e39-cf2d144bcd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Volume 33e6d0c6-4166-4237-967a-40091279dac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e6d0c6-4166-4237-967a-40091279dac4', 'volume_size': 1} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-746387852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e6d0c6-4166-4237-967a-40091279dac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0520a3ced17f4eccb25023cd8223ad8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:16:57Z,use_quota=True,user_id='bcfac1123a3345ac917ac99ab456c508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Creating volume 33e6d0c6-4166-4237-967a-40091279dac4 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:16:56 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:16:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:56 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 1073741824 Jul 08 16:16:56 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:57 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 1073741824" returned: 0 in 0.922s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:16:57 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 Jul 08 16:16:57 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:16:58 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4" returned: 0 in 0.856s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cf4504-72aa-43e2-9e39-cf2d144bcd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e6d0c6-4166-4237-967a-40091279dac4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60884905-f11d-42ed-a073-6cbdb4567a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=86,cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:16:58 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Volume volume-33e6d0c6-4166-4237-967a-40091279dac4 (33e6d0c6-4166-4237-967a-40091279dac4): created successfully Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60884905-f11d-42ed-a073-6cbdb4567a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:16:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Flow 'volume_create_manager' (ae180054-5f40-4969-af04-2216682b6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:16:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dbdd7f8f-5360-4fbb-96ba-5e09a7014ee0 tempest-AbsoluteLimitsTests-1321671199 None] Created volume successfully. Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Acquiring lock "cinder-33e6d0c6-4166-4237-967a-40091279dac4-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "cinder-33e6d0c6-4166-4237-967a-40091279dac4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Acquiring lock "cinder-quobyte-33e6d0c6-4166-4237-967a-40091279dac4" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "cinder-quobyte-33e6d0c6-4166-4237-967a-40091279dac4" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdcb60c-2ae5-4478-b490-549db37d97b5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:17:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:00 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 Jul 08 16:17:00 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:01 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4" returned: 0 in 1.128s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:01 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4 Jul 08 16:17:01 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:02 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33e6d0c6-4166-4237-967a-40091279dac4" returned: 0 in 0.869s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "cinder-quobyte-33e6d0c6-4166-4237-967a-40091279dac4" released by "delete_volume" :: held 2.060s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Created reservations ['1e08ffc4-3857-417c-a833-fbd902590aaa', '35eed19a-3df8-4ddd-a43d-363b6c095bd4', '5905aa7c-337f-47d5-8062-50e16836b9a1', 'd97a11ad-035f-401b-a22f-f29406570e60'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:02 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:17:02 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:03 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.789s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:03 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:17:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Deleted volume successfully. Jul 08 16:17:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-57cbaac9-bc24-4336-be18-1213ff2e7885 tempest-AbsoluteLimitsTests-1321671199 None] Lock "cinder-33e6d0c6-4166-4237-967a-40091279dac4-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4fc35d-8342-41cf-8bd9-a67a0df88f06]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:17:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:05 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 Jul 08 16:17:05 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:06 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" returned: 0 in 1.068s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.089s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7da67a5a-bc24-4dd9-8626-d404e4466a8a', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:17:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-70bcb304-0888-49af-802d-1030816aefa5 req-dbf645c9-a27b-4f3f-b056-9fa0870c138d tempest-ServerActionsTestOtherA-368961541 None] attachment_update completed successfully. Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Flow 'volume_create_manager' (edf20e7f-2ec1-4393-92e8-e02edc24cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeccfe37-7ecc-4d7c-a947-00dfeb2f3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeccfe37-7ecc-4d7c-a947-00dfeb2f3889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-607953452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78721bd4-a9d0-49f8-922f-9156e103401c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5023521168c436fba515bdf8215834b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:08Z,use_quota=True,user_id='dc5d9895714c407e8e01f04d3f27a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f6ff34-ae97-40a0-81c1-b1e483eac8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f6ff34-ae97-40a0-81c1-b1e483eac8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7466e2d-6b02-4d0b-b6e7-639b5769c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7466e2d-6b02-4d0b-b6e7-639b5769c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78721bd4-a9d0-49f8-922f-9156e103401c', 'volume_name': 'volume-78721bd4-a9d0-49f8-922f-9156e103401c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b769a0-f361-4f75-a348-f2bbc28a73fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b769a0-f361-4f75-a348-f2bbc28a73fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a94c5-defe-4be7-b541-5ba49c229146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Volume 78721bd4-a9d0-49f8-922f-9156e103401c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78721bd4-a9d0-49f8-922f-9156e103401c', 'volume_size': 1} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-607953452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78721bd4-a9d0-49f8-922f-9156e103401c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5023521168c436fba515bdf8215834b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:08Z,use_quota=True,user_id='dc5d9895714c407e8e01f04d3f27a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Creating volume 78721bd4-a9d0-49f8-922f-9156e103401c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:17:08 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:17:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:08 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c 1073741824 Jul 08 16:17:08 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:09 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c 1073741824" returned: 0 in 1.053s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:09 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c Jul 08 16:17:09 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:10 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c" returned: 0 in 0.677s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a94c5-defe-4be7-b541-5ba49c229146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78721bd4-a9d0-49f8-922f-9156e103401c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42a2e5b-1638-46cb-8a72-d4093a9930ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:10 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Volume volume-78721bd4-a9d0-49f8-922f-9156e103401c (78721bd4-a9d0-49f8-922f-9156e103401c): created successfully Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42a2e5b-1638-46cb-8a72-d4093a9930ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Flow 'volume_create_manager' (edf20e7f-2ec1-4393-92e8-e02edc24cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e532cd66-3819-480b-9245-e49eac1f8745 tempest-VolumesMetadataTest-2038466791 None] Created volume successfully. Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Acquiring lock "cinder-78721bd4-a9d0-49f8-922f-9156e103401c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "cinder-78721bd4-a9d0-49f8-922f-9156e103401c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Acquiring lock "cinder-quobyte-78721bd4-a9d0-49f8-922f-9156e103401c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "cinder-quobyte-78721bd4-a9d0-49f8-922f-9156e103401c" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ec225-f7c5-4143-837b-07c7353f3ef5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:17:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:11 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c Jul 08 16:17:11 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:12 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:12 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c Jul 08 16:17:12 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:13 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-78721bd4-a9d0-49f8-922f-9156e103401c" returned: 0 in 0.874s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "cinder-quobyte-78721bd4-a9d0-49f8-922f-9156e103401c" released by "delete_volume" :: held 1.803s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Created reservations ['93030880-fc99-4d55-9c0c-11d39ffbb096', 'cb526c64-127e-4d72-b852-49c6e1962f41', '874924f0-f155-4481-a192-666f8bb95131', 'b2e0350a-6c96-47cc-8425-53ae0010f220'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:13 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:17:13 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:14 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.850s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:17:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Deleted volume successfully. Jul 08 16:17:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebd57d2b-bb0b-4d65-b5c1-9c6cd4891673 tempest-VolumesMetadataTest-2038466791 None] Lock "cinder-78721bd4-a9d0-49f8-922f-9156e103401c-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-3a6b66dc-f3b9-419c-9668-f8d3cfbd5621 req-a16fbbfc-f620-4fd7-913c-78fae2e0e5a3 tempest-AttachVolumeNegativeTest-2005293778 None] Terminate volume connection completed successfully. Jul 08 16:17:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-3a6b66dc-f3b9-419c-9668-f8d3cfbd5621 req-a16fbbfc-f620-4fd7-913c-78fae2e0e5a3 tempest-AttachVolumeNegativeTest-2005293778 None] Deleting attachment 95e16f8a-0942-48af-8c63-7912b8ea0d37. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:17:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-52b45d47-8533-43e3-8314-d04636c71dca tempest-ServerActionsTestOtherA-368961541 None] Terminate volume connection completed successfully. Jul 08 16:17:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-52b45d47-8533-43e3-8314-d04636c71dca tempest-ServerActionsTestOtherA-368961541 None] Deleting attachment 7da67a5a-bc24-4dd9-8626-d404e4466a8a. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:17:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd372c4-f880-4b0d-983a-69b54d6c12b6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:17:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:19 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 Jul 08 16:17:19 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:19 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:17:19 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:20 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" returned: 0 in 1.124s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.160s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e21cc641-480a-4721-8e0c-1fafc8f4863f', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:17:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-a3e7add2-f98d-4b08-9d65-0b9157023e1b req-f64e7cd9-e2ef-4564-a5f8-56e985222a92 tempest-ServerActionsTestOtherA-368961541 None] attachment_update completed successfully. Jul 08 16:17:20 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.921s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 8 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:17:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Flow 'volume_create_manager' (9805829a-c4a3-4950-9160-d157e47040f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f888ac4-7b1b-4d12-a031-09eb0ba0a609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f888ac4-7b1b-4d12-a031-09eb0ba0a609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1057784849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5b32d-7b5e-4759-8437-86c01d37bd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a079c278e745989d3558ccb8eca67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:30Z,use_quota=True,user_id='26947d092b0e43f1b4399c7189137586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646ff308-3064-4db8-b875-5031e82e4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646ff308-3064-4db8-b875-5031e82e4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53dc5a5-4d2a-4251-bfa6-51cc31117386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53dc5a5-4d2a-4251-bfa6-51cc31117386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c5b32d-7b5e-4759-8437-86c01d37bd87', 'volume_name': 'volume-89c5b32d-7b5e-4759-8437-86c01d37bd87', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274752f9-7deb-4ec4-a4d7-265d0dc9cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274752f9-7deb-4ec4-a4d7-265d0dc9cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7605309d-ee4a-4627-9ab1-6d10cce03dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:30 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Volume 89c5b32d-7b5e-4759-8437-86c01d37bd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c5b32d-7b5e-4759-8437-86c01d37bd87', 'volume_size': 1} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1057784849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5b32d-7b5e-4759-8437-86c01d37bd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a079c278e745989d3558ccb8eca67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:30Z,use_quota=True,user_id='26947d092b0e43f1b4399c7189137586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Creating volume 89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:17:30 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:17:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:30 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 1073741824 Jul 08 16:17:30 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:31 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 1073741824" returned: 0 in 1.418s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:31 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:17:31 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:32 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 0.978s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7605309d-ee4a-4627-9ab1-6d10cce03dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c5b32d-7b5e-4759-8437-86c01d37bd87', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082344a1-d5a8-45cc-82e3-aa2e038776a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Volume volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 (89c5b32d-7b5e-4759-8437-86c01d37bd87): created successfully Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082344a1-d5a8-45cc-82e3-aa2e038776a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Flow 'volume_create_manager' (9805829a-c4a3-4950-9160-d157e47040f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:32 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0ac6ef20-eacf-487a-866b-6909d9666dd0 tempest-VolumesActionsTest-1123731254 None] Created volume successfully. Jul 08 16:17:42 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:17:42 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (77265bb8-d1d4-42d1-a6df-6514c790976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db903446-f352-4d59-ac7a-c8bc3997da45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db903446-f352-4d59-ac7a-c8bc3997da45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047318127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba661f6-9536-455a-bb4a-354e22535459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:43Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b686b9e5-b560-48b7-97bf-9ac827b240d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b686b9e5-b560-48b7-97bf-9ac827b240d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e55e2f-c425-4ce1-acf9-e6d3614af99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e55e2f-c425-4ce1-acf9-e6d3614af99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba661f6-9536-455a-bb4a-354e22535459', 'volume_name': 'volume-3ba661f6-9536-455a-bb4a-354e22535459', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb14bc6-9c85-42a3-b79a-0f739d9f13f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb14bc6-9c85-42a3-b79a-0f739d9f13f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11026000-22aa-43a9-9cf0-f96fde79b5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Volume 3ba661f6-9536-455a-bb4a-354e22535459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba661f6-9536-455a-bb4a-354e22535459', 'volume_size': 1} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047318127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba661f6-9536-455a-bb4a-354e22535459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:17:43Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Creating volume 3ba661f6-9536-455a-bb4a-354e22535459 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:17:43 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:17:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:43 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 1073741824 Jul 08 16:17:43 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:44 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 1073741824" returned: 0 in 1.319s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:44 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 Jul 08 16:17:44 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:45 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459" returned: 0 in 1.114s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (2477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11026000-22aa-43a9-9cf0-f96fde79b5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba661f6-9536-455a-bb4a-354e22535459', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ace520-1d04-42da-97b1-8060198a053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:17:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Volume volume-3ba661f6-9536-455a-bb4a-354e22535459 (3ba661f6-9536-455a-bb4a-354e22535459): created successfully Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ace520-1d04-42da-97b1-8060198a053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:17:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (77265bb8-d1d4-42d1-a6df-6514c790976a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:17:45 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ac5c372c-bccd-409f-b2bb-f5104a8ab813 tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:17:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e21d17c2-a81d-4fea-b9e6-f802c73a506d tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459" by "attach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e21d17c2-a81d-4fea-b9e6-f802c73a506d tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459" acquired by "attach_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e21d17c2-a81d-4fea-b9e6-f802c73a506d tempest-VolumesActionsTest-1533953821 None] Attaching volume 3ba661f6-9536-455a-bb4a-354e22535459 to instance 12ef57f3-f946-4094-8e8d-6b9f8781b497 at mountpoint /dev/vdb on host None. Jul 08 16:17:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e21d17c2-a81d-4fea-b9e6-f802c73a506d tempest-VolumesActionsTest-1533953821 None] Attach volume completed successfully. Jul 08 16:17:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e21d17c2-a81d-4fea-b9e6-f802c73a506d tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459" released by "attach_volume" :: held 0.171s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Terminate volume connection completed successfully. Jul 08 16:17:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" by "detach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Detaching volume 3ba661f6-9536-455a-bb4a-354e22535459 from instance 12ef57f3-f946-4094-8e8d-6b9f8781b497. Jul 08 16:17:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Detach volume completed successfully. Jul 08 16:17:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b2ab0bc2-1764-4455-8803-d755ca0f0024 tempest-VolumesActionsTest-633128952 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" released by "detach_volume" :: held 0.312s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d4813f5b-8f05-4518-87f1-8df5b6f84719 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" by "detach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d4813f5b-8f05-4518-87f1-8df5b6f84719 tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d4813f5b-8f05-4518-87f1-8df5b6f84719 tempest-VolumesActionsTest-1533953821 None] Volume detach called, but volume not attached. Jul 08 16:17:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d4813f5b-8f05-4518-87f1-8df5b6f84719 tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-quobyte-3ba661f6-9536-455a-bb4a-354e22535459" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "cinder-quobyte-3ba661f6-9536-455a-bb4a-354e22535459" acquired by "delete_volume" :: waited 0.044s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27986ca-0bb8-4e9b-89ca-537c76b12457]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:17:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:49 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 Jul 08 16:17:49 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:51 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459" returned: 0 in 2.043s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:51 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459 Jul 08 16:17:51 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:53 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ba661f6-9536-455a-bb4a-354e22535459" returned: 0 in 1.302s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "cinder-quobyte-3ba661f6-9536-455a-bb4a-354e22535459" released by "delete_volume" :: held 3.432s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Created reservations ['076570a2-307a-450d-a0f5-4e666065bc55', '7ab3fd72-8913-4f86-b243-2f45d42790c0', '5721df44-5f87-409b-9259-899a795214b3', '1723bae8-c99e-4a44-840d-d4a98c01917d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9f538039-1482-4b17-a517-8218dd15af2f tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" by "attach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:53 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:17:53 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9f538039-1482-4b17-a517-8218dd15af2f tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" acquired by "attach_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9f538039-1482-4b17-a517-8218dd15af2f tempest-VolumesActionsTest-1123731254 None] Attaching volume 89c5b32d-7b5e-4759-8437-86c01d37bd87 to instance c354770d-cc10-4208-ba96-999abc40bb21 at mountpoint /dev/vdb on host None. Jul 08 16:17:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9f538039-1482-4b17-a517-8218dd15af2f tempest-VolumesActionsTest-1123731254 None] Attach volume completed successfully. Jul 08 16:17:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9f538039-1482-4b17-a517-8218dd15af2f tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" released by "attach_volume" :: held 0.144s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8d84e798-665d-4156-bc37-e9ebff70d1d3 tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" by "detach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8d84e798-665d-4156-bc37-e9ebff70d1d3 tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:17:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8d84e798-665d-4156-bc37-e9ebff70d1d3 tempest-VolumesActionsTest-1123731254 None] Detaching volume 89c5b32d-7b5e-4759-8437-86c01d37bd87 from instance c354770d-cc10-4208-ba96-999abc40bb21. Jul 08 16:17:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8d84e798-665d-4156-bc37-e9ebff70d1d3 tempest-VolumesActionsTest-1123731254 None] Detach volume completed successfully. Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8d84e798-665d-4156-bc37-e9ebff70d1d3 tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:54 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.242s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:17:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Deleted volume successfully. Jul 08 16:17:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0929b5d3-d237-4bca-bc7d-79a7f5ab00dd tempest-VolumesActionsTest-1533953821 None] Lock "cinder-3ba661f6-9536-455a-bb4a-354e22535459-delete_volume" released by "delete_volume" :: held 5.151s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:17:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-31702ec9-e87d-4877-81b3-705c16eb422c req-9f685580-a513-4257-86e5-9f242df234bc tempest-ServerActionsTestOtherA-368961541 None] Terminate volume connection completed successfully. Jul 08 16:17:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-31702ec9-e87d-4877-81b3-705c16eb422c req-9f685580-a513-4257-86e5-9f242df234bc tempest-ServerActionsTestOtherA-368961541 None] Deleting attachment e21cc641-480a-4721-8e0c-1fafc8f4863f. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (49c5d20c-0e3b-40ed-9e3a-8a6dc29b76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bb09ba-7756-46ae-986d-b30069f77b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bb09ba-7756-46ae-986d-b30069f77b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692031952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a19b8d6-4548-4326-8258-acf43be35727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:04Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260e45ce-3f4d-470c-bee6-ba6394b5afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260e45ce-3f4d-470c-bee6-ba6394b5afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9108b22-02c0-436f-b225-127a2335481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9108b22-02c0-436f-b225-127a2335481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a19b8d6-4548-4326-8258-acf43be35727', 'volume_name': 'volume-5a19b8d6-4548-4326-8258-acf43be35727', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459fc587-20e1-406b-bd4a-d1aa4b305dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459fc587-20e1-406b-bd4a-d1aa4b305dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719610bc-cc0e-49f9-b9ca-0150a3ad6288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Volume 5a19b8d6-4548-4326-8258-acf43be35727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a19b8d6-4548-4326-8258-acf43be35727', 'volume_size': 1} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692031952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a19b8d6-4548-4326-8258-acf43be35727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:04Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Creating volume 5a19b8d6-4548-4326-8258-acf43be35727 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:03 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:03 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 1073741824 Jul 08 16:18:03 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:04 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 1073741824" returned: 0 in 1.040s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:05 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 Jul 08 16:18:05 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:05 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719610bc-cc0e-49f9-b9ca-0150a3ad6288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a19b8d6-4548-4326-8258-acf43be35727', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d7acff-15d0-4c00-9944-a56cbd3d5d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Volume volume-5a19b8d6-4548-4326-8258-acf43be35727 (5a19b8d6-4548-4326-8258-acf43be35727): created successfully Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d7acff-15d0-4c00-9944-a56cbd3d5d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (49c5d20c-0e3b-40ed-9e3a-8a6dc29b76d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4ba13ee6-0ddc-46ec-9bda-17305b74872f tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-5a19b8d6-4548-4326-8258-acf43be35727-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "cinder-5a19b8d6-4548-4326-8258-acf43be35727-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-quobyte-5a19b8d6-4548-4326-8258-acf43be35727" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-5a19b8d6-4548-4326-8258-acf43be35727" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[59268276-30c3-4c2f-b4b1-ba11f4e4b87e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:07 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 Jul 08 16:18:07 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:08 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727" returned: 0 in 0.767s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:08 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727 Jul 08 16:18:08 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:08 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a19b8d6-4548-4326-8258-acf43be35727" returned: 0 in 0.705s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-5a19b8d6-4548-4326-8258-acf43be35727" released by "delete_volume" :: held 1.520s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Created reservations ['56de2360-874f-4c4e-af07-6117e2635a3d', 'a77bae1a-d241-45db-93fe-7f23cb629871', '38fdac91-4797-40c1-b1dd-cf867179924c', '743761f3-20e0-4926-9b0c-1eee9508c4bb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:08 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:08 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "cinder-608fa0f5-3f6c-4dfa-bf93-2a749b78de79-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "cinder-608fa0f5-3f6c-4dfa-bf93-2a749b78de79-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "cinder-quobyte-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "cinder-quobyte-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[430addd9-d02b-4076-a1c2-5dadb3e3474f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:09 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 Jul 08 16:18:09 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:09 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Deleted volume successfully. Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f5bb058-9a55-4109-adc4-e993e58dd268 tempest-VolumesActionsTest-633128952 None] Lock "cinder-5a19b8d6-4548-4326-8258-acf43be35727-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (aa2a9934-e652-4493-8ec8-215f59ed3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322d89cc-e250-41f1-9cdc-67d7bb60d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322d89cc-e250-41f1-9cdc-67d7bb60d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112259139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0413db2-71f4-4e12-8a5d-9958de86bf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:10Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3208b3-64f7-41e1-a188-7a55f7ca1f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3208b3-64f7-41e1-a188-7a55f7ca1f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88339e9-d48a-4dca-8167-ea28bc8e27f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88339e9-d48a-4dca-8167-ea28bc8e27f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0413db2-71f4-4e12-8a5d-9958de86bf3b', 'volume_name': 'volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb63002-412b-4f6f-ae34-9afd7b530331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb63002-412b-4f6f-ae34-9afd7b530331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c52e4-076f-49d6-bc2f-5db312d4b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:10 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Volume c0413db2-71f4-4e12-8a5d-9958de86bf3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b', 'volume_size': 1} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112259139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0413db2-71f4-4e12-8a5d-9958de86bf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:10Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Creating volume c0413db2-71f4-4e12-8a5d-9958de86bf3b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:10 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:10 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" returned: 0 in 0.864s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:10 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b 1073741824 Jul 08 16:18:10 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:10 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79 Jul 08 16:18:10 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:10 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" returned: 0 in 0.779s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "cinder-quobyte-608fa0f5-3f6c-4dfa-bf93-2a749b78de79" released by "delete_volume" :: held 1.688s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Created reservations ['351df362-496c-4045-b1db-77ffabc8926f', 'fcac098b-4168-4a03-a0d1-bbabe53e6541', '85b7343e-454e-472b-88f4-db7e9c02b768', 'ab1abe55-cbdb-48d1-861b-44071c8ac0d8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:11 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:11 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:11 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b 1073741824" returned: 0 in 1.083s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:11 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b Jul 08 16:18:11 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:11 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:11 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Deleted volume successfully. Jul 08 16:18:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba2fec3b-6d33-4006-9310-01156546753a tempest-ServerActionsTestOtherA-368961541 None] Lock "cinder-608fa0f5-3f6c-4dfa-bf93-2a749b78de79-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:12 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b" returned: 0 in 1.020s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c52e4-076f-49d6-bc2f-5db312d4b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856eb43a-da1e-43a4-a137-1bd0789e63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:12 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Volume volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b (c0413db2-71f4-4e12-8a5d-9958de86bf3b): created successfully Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856eb43a-da1e-43a4-a137-1bd0789e63f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (aa2a9934-e652-4493-8ec8-215f59ed3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e7d2bc29-ce3f-4c7f-9bdd-aab0eca9f416 tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-c0413db2-71f4-4e12-8a5d-9958de86bf3b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "cinder-c0413db2-71f4-4e12-8a5d-9958de86bf3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-quobyte-c0413db2-71f4-4e12-8a5d-9958de86bf3b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-c0413db2-71f4-4e12-8a5d-9958de86bf3b" acquired by "delete_volume" :: waited 0.089s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee656f40-6584-44ea-be9f-1affe78f267b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:13 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b Jul 08 16:18:13 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:14 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b" returned: 0 in 1.109s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:14 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b Jul 08 16:18:14 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:15 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c0413db2-71f4-4e12-8a5d-9958de86bf3b" returned: 0 in 0.750s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-c0413db2-71f4-4e12-8a5d-9958de86bf3b" released by "delete_volume" :: held 1.926s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Created reservations ['67baca7c-729c-4e68-96c7-c0c0e5b5e385', '04914de7-4dea-43c6-a57f-646ce47d44b1', '165c61a2-83be-4aba-bbb5-26fa50564453', '26ea21fc-96f1-4836-8e18-b837ba5085f4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:15 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:15 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:16 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.932s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Deleted volume successfully. Jul 08 16:18:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d6591534-d0a5-4702-9aec-959961681ebc tempest-VolumesActionsTest-633128952 None] Lock "cinder-c0413db2-71f4-4e12-8a5d-9958de86bf3b-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (5e0051a9-50b4-4f12-a264-03113e3f0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9872b7-6625-4729-bfe1-edf9289bf383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9872b7-6625-4729-bfe1-edf9289bf383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939135745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:17Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba248d8-f90c-4a9d-ac41-a3a7fb0e912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba248d8-f90c-4a9d-ac41-a3a7fb0e912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e416d7e-b614-4df8-8223-b034da79b2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e416d7e-b614-4df8-8223-b034da79b2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11', 'volume_name': 'volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab34855-4ad1-4aee-863e-a68bb8096ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab34855-4ad1-4aee-863e-a68bb8096ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d565f-b01d-4b84-b390-c2ea24b56cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Volume 0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11', 'volume_size': 1} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939135745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:17Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Creating volume 0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:17 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:17 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 1073741824 Jul 08 16:18:17 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:18 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 1073741824" returned: 0 in 1.054s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:18 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 Jul 08 16:18:18 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (746813e0-6287-4824-8afe-58d5b1ff7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d891946c-95b3-461a-8b27-60b1707da341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d891946c-95b3-461a-8b27-60b1707da341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-949416609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6925eb31-aa08-4408-90f1-86d7f79f22d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:19Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ce7c6-ec53-4584-b6c8-041ce4dabdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ce7c6-ec53-4584-b6c8-041ce4dabdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0d0e19-2679-40c6-990e-639b605a60a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0d0e19-2679-40c6-990e-639b605a60a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6925eb31-aa08-4408-90f1-86d7f79f22d3', 'volume_name': 'volume-6925eb31-aa08-4408-90f1-86d7f79f22d3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aca89d4-fac1-4405-b189-37297129f24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aca89d4-fac1-4405-b189-37297129f24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba408d7a-c448-412a-9816-9cf56cb03d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:18 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Volume 6925eb31-aa08-4408-90f1-86d7f79f22d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6925eb31-aa08-4408-90f1-86d7f79f22d3', 'volume_size': 1} Jul 08 16:18:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:19 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" returned: 0 in 0.805s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-949416609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6925eb31-aa08-4408-90f1-86d7f79f22d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:19Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Creating volume 6925eb31-aa08-4408-90f1-86d7f79f22d3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:19 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d565f-b01d-4b84-b390-c2ea24b56cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c917a86f-c6e3-4d6a-8910-aa2db85781e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:19 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 1073741824 Jul 08 16:18:19 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:19 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Volume volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 (0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11): created successfully Jul 08 16:18:19 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:19 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c917a86f-c6e3-4d6a-8910-aa2db85781e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (5e0051a9-50b4-4f12-a264-03113e3f0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-775a24a7-7222-49e4-b35b-11c3cfef8a11 tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:18:20 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.960s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 8 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:18:20 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 1073741824" returned: 0 in 1.564s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:20 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 Jul 08 16:18:20 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "cinder-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-quobyte-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1a53b-2d0a-469f-8fa4-e7132499ebf0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a3bbbfb7-39cf-49c5-96cf-f404921a0ffb tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" by "attach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a3bbbfb7-39cf-49c5-96cf-f404921a0ffb tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" acquired by "attach_volume" :: waited 0.051s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:21 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 Jul 08 16:18:21 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a3bbbfb7-39cf-49c5-96cf-f404921a0ffb tempest-VolumesActionsTest-1123731254 None] Attaching volume 89c5b32d-7b5e-4759-8437-86c01d37bd87 to instance d64f5b88-79b7-440d-9b52-6837c7de9041 at mountpoint /dev/vdb on host None. Jul 08 16:18:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a3bbbfb7-39cf-49c5-96cf-f404921a0ffb tempest-VolumesActionsTest-1123731254 None] Attach volume completed successfully. Jul 08 16:18:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a3bbbfb7-39cf-49c5-96cf-f404921a0ffb tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87" released by "attach_volume" :: held 0.194s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5b602ef3-f880-4d01-86c9-2e53b8c07535 tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" by "detach_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5b602ef3-f880-4d01-86c9-2e53b8c07535 tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5b602ef3-f880-4d01-86c9-2e53b8c07535 tempest-VolumesActionsTest-1123731254 None] Detaching volume 89c5b32d-7b5e-4759-8437-86c01d37bd87 from instance d64f5b88-79b7-440d-9b52-6837c7de9041. Jul 08 16:18:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5b602ef3-f880-4d01-86c9-2e53b8c07535 tempest-VolumesActionsTest-1123731254 None] Detach volume completed successfully. Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5b602ef3-f880-4d01-86c9-2e53b8c07535 tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:22 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3" returned: 0 in 1.259s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] <== create_volume: return (2909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.914s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba408d7a-c448-412a-9816-9cf56cb03d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6925eb31-aa08-4408-90f1-86d7f79f22d3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5e7bf-24c4-4506-955a-3e64e8b00c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:22 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Volume volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 (6925eb31-aa08-4408-90f1-86d7f79f22d3): created successfully Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5e7bf-24c4-4506-955a-3e64e8b00c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (746813e0-6287-4824-8afe-58d5b1ff7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9086364b-1c2a-4852-9ead-84518ad844d9 tempest-AttachVolumeNegativeTest-2005293778 None] Created volume successfully. Jul 08 16:18:22 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" returned: 0 in 1.221s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:22 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11 Jul 08 16:18:22 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:23 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" returned: 0 in 0.967s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11" released by "delete_volume" :: held 2.265s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Created reservations ['71438b50-1d6c-4e82-8c60-97b386cd9fe0', 'a8712035-3302-459f-935f-b37abe6482ff', '93123734-0719-4015-8898-07ba3538656c', '18a733ea-515b-4a6c-bc6d-80a13c3fff4c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:23 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:23 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:24 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:24 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Deleted volume successfully. Jul 08 16:18:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-eb514e90-8d57-45d3-9ceb-ce2c1fa9483a tempest-VolumesActionsTest-633128952 None] Lock "cinder-0c94eb03-7aa9-4333-8fdb-bfcdbdd01e11-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (3a5fbe77-a5e2-4da2-8a2b-53d6b9f5bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf22486-d7bb-47db-8571-9e7e6f492ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf22486-d7bb-47db-8571-9e7e6f492ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979472873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4923b8-e4f3-41d1-ba56-92cedf7aed10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:25Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b556b78-9d54-4e0e-a985-5f6e481a87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b556b78-9d54-4e0e-a985-5f6e481a87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c742467-fe22-4570-a81a-394eac67ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c742467-fe22-4570-a81a-394eac67ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4923b8-e4f3-41d1-ba56-92cedf7aed10', 'volume_name': 'volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0382c201-2c19-4406-8fd4-680821623d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0382c201-2c19-4406-8fd4-680821623d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75138506-fee3-45c5-80fa-34fac5c2fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Volume da4923b8-e4f3-41d1-ba56-92cedf7aed10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10', 'volume_size': 1} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979472873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4923b8-e4f3-41d1-ba56-92cedf7aed10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:25Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Creating volume da4923b8-e4f3-41d1-ba56-92cedf7aed10 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:25 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:25 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 1073741824 Jul 08 16:18:25 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:26 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 1073741824" returned: 0 in 1.128s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:26 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 Jul 08 16:18:26 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:27 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10" returned: 0 in 0.673s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75138506-fee3-45c5-80fa-34fac5c2fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895cc0c8-1f63-41fa-ab18-6a2dbabe8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f3061-a80c-46ca-8370-aca31cc2ce93]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:27 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Volume volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 (da4923b8-e4f3-41d1-ba56-92cedf7aed10): created successfully Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895cc0c8-1f63-41fa-ab18-6a2dbabe8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (3a5fbe77-a5e2-4da2-8a2b-53d6b9f5bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-784e8a0f-a369-40be-bf81-9745b750e53a tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:18:27 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 Jul 08 16:18:27 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:28 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3" returned: 0 in 0.830s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-6925eb31-aa08-4408-90f1-86d7f79f22d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc291bfb-8fd5-4c3c-b46b-54d4bc65b571', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:18:28 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-f85d219c-8708-49ac-9788-d68f48afba13 req-562b6765-24ea-43a1-b26a-286d21b6ab64 tempest-AttachVolumeNegativeTest-2005293778 None] attachment_update completed successfully. Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-da4923b8-e4f3-41d1-ba56-92cedf7aed10-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "cinder-da4923b8-e4f3-41d1-ba56-92cedf7aed10-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Acquiring lock "cinder-quobyte-da4923b8-e4f3-41d1-ba56-92cedf7aed10" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-da4923b8-e4f3-41d1-ba56-92cedf7aed10" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1e931-d21f-4b03-8ae1-07b517b0eeb4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:28 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 Jul 08 16:18:28 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:29 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10" returned: 0 in 0.971s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:29 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10 Jul 08 16:18:29 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:30 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-da4923b8-e4f3-41d1-ba56-92cedf7aed10" returned: 0 in 0.706s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "cinder-quobyte-da4923b8-e4f3-41d1-ba56-92cedf7aed10" released by "delete_volume" :: held 1.732s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Created reservations ['67992305-7185-4162-8b8a-5e582ab25b7a', '5d06c83a-030c-4d2f-9554-28d0d676b0e0', 'b57a7948-5a79-482d-8001-463252f24850', '8f850652-0c2b-4bca-a1dd-9d2b220072e9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:30 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:30 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:31 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.745s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Deleted volume successfully. Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-357c7834-74b4-4bf6-b0d0-fb2331d486a0 tempest-VolumesActionsTest-633128952 None] Lock "cinder-da4923b8-e4f3-41d1-ba56-92cedf7aed10-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (6dc81bab-06be-4316-9c82-455089aea0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fe9337-0499-45d7-b6dd-2f37763b1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fe9337-0499-45d7-b6dd-2f37763b1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492154434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5efadf-e7bf-496b-936f-07b872855dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:32Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2771294-2608-4b0a-a1af-8ca47e51ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2771294-2608-4b0a-a1af-8ca47e51ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369250ad-817f-42da-a1d9-50e65be2441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369250ad-817f-42da-a1d9-50e65be2441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f5efadf-e7bf-496b-936f-07b872855dbf', 'volume_name': 'volume-7f5efadf-e7bf-496b-936f-07b872855dbf', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbdbf46-c821-4aab-8f0f-8e411188eb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbdbf46-c821-4aab-8f0f-8e411188eb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a3d5fb-34a1-4761-9e2e-51194542229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Volume 7f5efadf-e7bf-496b-936f-07b872855dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f5efadf-e7bf-496b-936f-07b872855dbf', 'volume_size': 1} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492154434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5efadf-e7bf-496b-936f-07b872855dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8b06a24862442683067ae9dad1558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:18:32Z,use_quota=True,user_id='421bd17134294c6392de2e313fe130a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Creating volume 7f5efadf-e7bf-496b-936f-07b872855dbf {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:18:31 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:31 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf 1073741824 Jul 08 16:18:31 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:32 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf 1073741824" returned: 0 in 0.867s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:32 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf Jul 08 16:18:32 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:33 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf" returned: 0 in 0.715s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.496s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a3d5fb-34a1-4761-9e2e-51194542229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5efadf-e7bf-496b-936f-07b872855dbf', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0375b446-10c1-42ec-af5e-77089ae58ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[62000db7-38d9-43a7-a92f-bb88ad4db303]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Volume volume-7f5efadf-e7bf-496b-936f-07b872855dbf (7f5efadf-e7bf-496b-936f-07b872855dbf): created successfully Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0375b446-10c1-42ec-af5e-77089ae58ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:18:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Flow 'volume_create_manager' (6dc81bab-06be-4316-9c82-455089aea0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:18:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-72f09742-179d-4d21-9372-ca8cb6c405c8 tempest-VolumesActionsTest-1533953821 None] Created volume successfully. Jul 08 16:18:33 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:18:33 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:34 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 0.955s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[26479c1f-c43b-477c-aa00-87f50ebb5b3b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:34 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:18:34 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-e408487f-08e2-475a-acae-6aa1db708dfb req-d77bdefb-b7ff-4b3e-befc-ccb866def9fd tempest-AttachVolumeNegativeTest-2005293778 None] Terminate volume connection completed successfully. Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-e408487f-08e2-475a-acae-6aa1db708dfb req-d77bdefb-b7ff-4b3e-befc-ccb866def9fd tempest-AttachVolumeNegativeTest-2005293778 None] Deleting attachment cc291bfb-8fd5-4c3c-b46b-54d4bc65b571. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-7f5efadf-e7bf-496b-936f-07b872855dbf-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "cinder-7f5efadf-e7bf-496b-936f-07b872855dbf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Acquiring lock "cinder-quobyte-7f5efadf-e7bf-496b-936f-07b872855dbf" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "cinder-quobyte-7f5efadf-e7bf-496b-936f-07b872855dbf" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ba907-dc9e-4ad4-a196-542c04e76fd1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:35 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf Jul 08 16:18:35 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:35 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 1.055s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.02416e5f-df9a-473e-be7f-342f036c436689o1949n.img {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:35 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.02416e5f-df9a-473e-be7f-342f036c436689o1949n.img Jul 08 16:18:35 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:36 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf" returned: 0 in 1.051s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:36 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf Jul 08 16:18:36 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:38 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7f5efadf-e7bf-496b-936f-07b872855dbf" returned: 0 in 2.065s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "cinder-quobyte-7f5efadf-e7bf-496b-936f-07b872855dbf" released by "delete_volume" :: held 3.183s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Created reservations ['ae574628-022e-4862-be45-ad64b1d47324', '48578026-b185-4625-b6c7-de1eaac8156a', '1a2aeaf1-6ecf-4b5c-9f32-e6c9a57c708c', '1f2bf0b1-ebf6-4a17-9614-89871762bd65'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:18:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:38 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:18:38 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:40 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.436s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:40 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:18:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Deleted volume successfully. Jul 08 16:18:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2ada5882-0f05-42b4-bb4c-76fee98cd45f tempest-VolumesActionsTest-1533953821 None] Lock "cinder-7f5efadf-e7bf-496b-936f-07b872855dbf-delete_volume" released by "delete_volume" :: held 5.208s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:18:42 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.02416e5f-df9a-473e-be7f-342f036c436689o1949n.img" returned: 0 in 6.903s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:42 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9343206-3e1c-4e63-8c25-79330db54731]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:18:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:18:42 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:18:42 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:18:43 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 08 16:18:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 1.211s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:18:43 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.02416e5f-df9a-473e-be7f-342f036c436689o1949n.img {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:18:43 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Converted 1024.00 MB image at 148.32 MB/s Jul 08 16:18:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=87,cinder:UPDATE=82,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:18:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=71,cinder:UPDATE=95,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:18:43 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] 02416e5f-df9a-473e-be7f-342f036c4366 was raw, no need to convert to raw {{(pid=87227) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:19 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:19:19 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Flow 'volume_create_manager' (698164e0-c683-46ff-8e4f-eeed44a45887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b251c4-3862-4829-b07e-4708ff276be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b251c4-3862-4829-b07e-4708ff276be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1337878494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d94ea4b-36a9-4798-9f6d-6aee00f7e50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5a2769a04f447b291f07b3acddf49de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:20Z,use_quota=True,user_id='6309876e818e4c989df1c2fa7349bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6934a0-03aa-4b36-8d11-38755763dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6934a0-03aa-4b36-8d11-38755763dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cc3f1-7620-475d-a4c4-3c9ce34ee5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cc3f1-7620-475d-a4c4-3c9ce34ee5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d94ea4b-36a9-4798-9f6d-6aee00f7e50f', 'volume_name': 'volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64e78e-e0be-4af1-a777-53aece5d2a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64e78e-e0be-4af1-a777-53aece5d2a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8096ea-b367-4a59-8f52-f323e842ac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:20 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Volume 1d94ea4b-36a9-4798-9f6d-6aee00f7e50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f', 'volume_size': 1} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:20 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 47.544s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Uploaded volume to glance image-id: 02416e5f-df9a-473e-be7f-342f036c4366. {{(pid=87227) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1337878494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d94ea4b-36a9-4798-9f6d-6aee00f7e50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5a2769a04f447b291f07b3acddf49de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:20Z,use_quota=True,user_id='6309876e818e4c989df1c2fa7349bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Creating volume 1d94ea4b-36a9-4798-9f6d-6aee00f7e50f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:20 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.520s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:19:20 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f 1073741824 Jul 08 16:19:20 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:19:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:19:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a6ff59af-25b5-44ef-9826-f0981e2e866d tempest-VolumesActionsTest-1123731254 None] Copy volume to image completed successfully. Jul 08 16:19:22 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f 1073741824" returned: 0 in 1.635s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:22 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f Jul 08 16:19:22 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:23 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" returned: 0 in 1.299s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] <== create_volume: return (3033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.036s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.346s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efcc12d-83c6-4696-ad4d-41968feb24a3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8096ea-b367-4a59-8f52-f323e842ac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffbe91c-db85-4e0f-8282-5c91b5c21542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Volume volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f (1d94ea4b-36a9-4798-9f6d-6aee00f7e50f): created successfully Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffbe91c-db85-4e0f-8282-5c91b5c21542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Flow 'volume_create_manager' (698164e0-c683-46ff-8e4f-eeed44a45887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c0c32389-9aab-432b-a76d-15201a89b181 tempest-VolumesTransfersV357Test-291793965 None] Created volume successfully. Jul 08 16:19:24 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:19:24 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Flow 'volume_create_manager' (5542a633-07c7-4435-8f67-5737c512672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58e87e2-2751-4052-9ecf-0ae85e16ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58e87e2-2751-4052-9ecf-0ae85e16ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2097941276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa561aa9-8443-4780-b872-cf1453a1addd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2a88ce44c7439a8d62a651cf410cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:25Z,use_quota=True,user_id='518bec335c9647f4925531cdf7fbe02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d47a8-2dbe-454a-b9ed-117e55171987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d47a8-2dbe-454a-b9ed-117e55171987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a472201a-de54-4017-82c7-6285f70a9f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a472201a-de54-4017-82c7-6285f70a9f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa561aa9-8443-4780-b872-cf1453a1addd', 'volume_name': 'volume-fa561aa9-8443-4780-b872-cf1453a1addd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de085b-dca5-48a4-9672-8e9584f2afa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de085b-dca5-48a4-9672-8e9584f2afa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dae5eb-7363-4dcb-b3fe-a2e55bf8f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Volume fa561aa9-8443-4780-b872-cf1453a1addd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa561aa9-8443-4780-b872-cf1453a1addd', 'volume_size': 1} Jul 08 16:19:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:25 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 1.198s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:25 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec9ade-5fe7-4338-95da-6a82bf1224f3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:25 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:19:25 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1b5f766e-f305-440b-8d65-3506cf2a2874 tempest-VolumesTransfersV357Test-1761918855 None] Transfer volume completed successfully. Jul 08 16:19:26 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 1.125s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:26 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img Jul 08 16:19:26 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "cinder-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "cinder-quobyte-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-quobyte-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" acquired by "delete_volume" :: waited 0.072s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30b289-d7e4-4573-86ad-48258c509ca8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:28 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f Jul 08 16:19:28 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:30 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" returned: 0 in 3.384s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:31 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f Jul 08 16:19:31 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:33 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" returned: 0 in 2.176s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-quobyte-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f" released by "delete_volume" :: held 5.739s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Created reservations ['87e8b736-6820-40eb-b495-25b581167a3d', 'a73e2d74-4d0f-46b1-8e00-b577dfa9a163', 'e9fd0503-72b8-4d00-8b66-c30104bd7a8a', '2878a156-4b9f-4f74-918e-3edb895c8f31'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:33 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:19:33 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:34 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img" returned: 0 in 8.462s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[038ff874-f575-4c3f-b768-b847fe8cbcb8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:35 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:19:35 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:35 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.534s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Flow 'volume_create_manager' (0d1a208c-261b-481a-910f-08d2bf4808f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe65aeb-d8ca-4425-8085-b7aa45dd420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Deleted volume successfully. Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe65aeb-d8ca-4425-8085-b7aa45dd420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1046527086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9d768c-c62f-4e61-8d03-463fade4b44f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5a2769a04f447b291f07b3acddf49de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:35Z,use_quota=True,user_id='6309876e818e4c989df1c2fa7349bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bced15dd-c589-4f3d-a613-51f2eea06bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bced15dd-c589-4f3d-a613-51f2eea06bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10401f0a-d7d4-4f16-955b-cb618edf06e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10401f0a-d7d4-4f16-955b-cb618edf06e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9d768c-c62f-4e61-8d03-463fade4b44f', 'volume_name': 'volume-3f9d768c-c62f-4e61-8d03-463fade4b44f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93fb864-90ee-4a18-a818-8d0b2609be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93fb864-90ee-4a18-a818-8d0b2609be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ff3719-0550-419c-9aa9-62c4061c2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:35 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Volume 3f9d768c-c62f-4e61-8d03-463fade4b44f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9d768c-c62f-4e61-8d03-463fade4b44f', 'volume_size': 1} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e83be75b-1de6-41ea-bfbb-63f6ec57c10c tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-1d94ea4b-36a9-4798-9f6d-6aee00f7e50f-delete_volume" released by "delete_volume" :: held 8.064s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:35 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 1.065s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87, size 1024.00 MB, duration 8.46 sec, destination /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:19:35 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Converted 1024.00 MB image at 121.00 MB/s Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] eb83c239-e657-4129-922b-0ac9bff1d9b3 was raw, converting to qcow2 {{(pid=87227) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2816ed72-a723-4a95-9b96-0b24bfbe3eea]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:36 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img Jul 08 16:19:36 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:36 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:36 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img Jul 08 16:19:36 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:37 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img" returned: 1 in 0.775s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:19:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img /opt/stack/data/cinder/conversion/vol_upload_re0np2bj {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:37 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img /opt/stack/data/cinder/conversion/vol_upload_re0np2bj Jul 08 16:19:37 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:38 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img /opt/stack/data/cinder/conversion/vol_upload_re0np2bj" returned: 0 in 0.671s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:38 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Image conversion details: src /opt/stack/data/cinder/conversion/89c5b32d-7b5e-4759-8437-86c01d37bd87.temp_image.eb83c239-e657-4129-922b-0ac9bff1d9b3usm3rm7s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_re0np2bj {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:19:38 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 16:19:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d31ab-d050-483a-97cc-61481d58be43]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_re0np2bj {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:38 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_re0np2bj Jul 08 16:19:38 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:38 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_re0np2bj" returned: 0 in 0.745s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.313s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Uploaded volume to glance image-id: eb83c239-e657-4129-922b-0ac9bff1d9b3. {{(pid=87227) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.452s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2097941276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa561aa9-8443-4780-b872-cf1453a1addd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2a88ce44c7439a8d62a651cf410cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:25Z,use_quota=True,user_id='518bec335c9647f4925531cdf7fbe02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Creating volume fa561aa9-8443-4780-b872-cf1453a1addd {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:40 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:40 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd 1073741824 Jul 08 16:19:40 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e5734f98-b96f-4486-80dd-ea776abd81b2 tempest-VolumesActionsTest-1123731254 None] Copy volume to image completed successfully. Jul 08 16:19:41 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd 1073741824" returned: 0 in 0.879s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:41 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd Jul 08 16:19:41 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Acquiring lock "cinder-quobyte-89c5b32d-7b5e-4759-8437-86c01d37bd87" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "cinder-quobyte-89c5b32d-7b5e-4759-8437-86c01d37bd87" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef977ff2-7e32-40f4-835a-9f76988fde9c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:41 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:19:41 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:41 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd" returned: 0 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.621s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1046527086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9d768c-c62f-4e61-8d03-463fade4b44f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5a2769a04f447b291f07b3acddf49de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:35Z,use_quota=True,user_id='6309876e818e4c989df1c2fa7349bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Creating volume 3f9d768c-c62f-4e61-8d03-463fade4b44f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:41 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dae5eb-7363-4dcb-b3fe-a2e55bf8f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa561aa9-8443-4780-b872-cf1453a1addd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:41 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f 1073741824 Jul 08 16:19:41 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf3e196-f433-484b-8507-f749c9b52801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Volume volume-fa561aa9-8443-4780-b872-cf1453a1addd (fa561aa9-8443-4780-b872-cf1453a1addd): created successfully Jul 08 16:19:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf3e196-f433-484b-8507-f749c9b52801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Flow 'volume_create_manager' (5542a633-07c7-4435-8f67-5737c512672f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-45657bc7-596c-4c42-b27b-532701677156 tempest-ServerRescueNegativeTestJSON-1436568311 None] Created volume successfully. Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (93dd8e30-10e1-4855-aeb6-a15756eb235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddae0721-8ff1-440e-9fc9-ae065391538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddae0721-8ff1-440e-9fc9-ae065391538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-73533436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca3d0b7-dedf-4d05-acff-2c43759a9208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:42Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2516dd-c2d6-4802-b8b4-63a3d27b95c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2516dd-c2d6-4802-b8b4-63a3d27b95c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861f6fea-42f1-4ef2-97d2-0cdac5a77551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861f6fea-42f1-4ef2-97d2-0cdac5a77551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca3d0b7-dedf-4d05-acff-2c43759a9208', 'volume_name': 'volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eaa3cc5-ceae-4403-8e4b-1bb7a36df270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eaa3cc5-ceae-4403-8e4b-1bb7a36df270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee63968-f980-41cb-82b0-d46b7ec1a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Volume 3ca3d0b7-dedf-4d05-acff-2c43759a9208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208', 'volume_size': 1} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:42 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 0.805s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:42 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87 Jul 08 16:19:42 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:42 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f 1073741824" returned: 0 in 0.923s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:42 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f Jul 08 16:19:42 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:43 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-89c5b32d-7b5e-4759-8437-86c01d37bd87" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "cinder-quobyte-89c5b32d-7b5e-4759-8437-86c01d37bd87" released by "delete_volume" :: held 1.557s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Created reservations ['a6055e48-7f79-4a36-8e52-ac7fd156866f', 'eff880f1-d11e-4d15-a661-1298a18ef7e1', 'ab3782bd-5cf4-4edc-86d0-9014bbccf06e', 'fb60486d-3486-4b8d-af69-dac3ebdc86d4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:43 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:19:43 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:43 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f" returned: 0 in 0.799s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-73533436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca3d0b7-dedf-4d05-acff-2c43759a9208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f47d286d424554ab001309de04faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:42Z,use_quota=True,user_id='a7ee5500cc4447f79bb1771baba9733a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Creating volume 3ca3d0b7-dedf-4d05-acff-2c43759a9208 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:43 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ff3719-0550-419c-9aa9-62c4061c2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9d768c-c62f-4e61-8d03-463fade4b44f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579825f6-c8a5-447c-bc6b-3c79b488ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:43 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 1073741824 Jul 08 16:19:43 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Volume volume-3f9d768c-c62f-4e61-8d03-463fade4b44f (3f9d768c-c62f-4e61-8d03-463fade4b44f): created successfully Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579825f6-c8a5-447c-bc6b-3c79b488ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Flow 'volume_create_manager' (0d1a208c-261b-481a-910f-08d2bf4808f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-53ed9fe3-5517-4ce9-8737-1af21e9b618f tempest-VolumesTransfersV357Test-291793965 None] Created volume successfully. Jul 08 16:19:44 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.730s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:44 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:19:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Deleted volume successfully. Jul 08 16:19:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bc4302b0-e1fd-4c86-bd83-09bff70626ec tempest-VolumesActionsTest-1123731254 None] Lock "cinder-89c5b32d-7b5e-4759-8437-86c01d37bd87-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:44 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 1073741824" returned: 0 in 1.033s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:44 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 Jul 08 16:19:44 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "cinder-3f9d768c-c62f-4e61-8d03-463fade4b44f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-3f9d768c-c62f-4e61-8d03-463fade4b44f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "cinder-quobyte-3f9d768c-c62f-4e61-8d03-463fade4b44f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-quobyte-3f9d768c-c62f-4e61-8d03-463fade4b44f" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34e27f-54d1-4291-a9c5-13a6a5b66121]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:45 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f Jul 08 16:19:45 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:45 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208" returned: 0 in 1.116s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee63968-f980-41cb-82b0-d46b7ec1a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9f3c0-675d-4fad-bf9a-88ede980a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Volume volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 (3ca3d0b7-dedf-4d05-acff-2c43759a9208): created successfully Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9f3c0-675d-4fad-bf9a-88ede980a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Flow 'volume_create_manager' (93dd8e30-10e1-4855-aeb6-a15756eb235c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-148b28e5-9ee0-4d5a-952a-47995bed6a6c tempest-AttachVolumeNegativeTest-2005293778 None] Created volume successfully. Jul 08 16:19:46 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f" returned: 0 in 1.033s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:46 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f Jul 08 16:19:46 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:47 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f9d768c-c62f-4e61-8d03-463fade4b44f" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-quobyte-3f9d768c-c62f-4e61-8d03-463fade4b44f" released by "delete_volume" :: held 1.877s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Created reservations ['0d41b2ca-f49b-467f-890a-a9038d3f11d7', 'd466af77-045b-402b-85bd-c5a2e17cfa4d', '29fed6b4-e391-4ee8-890a-e0e8802b5be0', '673e5832-9c3c-44ac-97ca-9f266c46f9f5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:47 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:19:47 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:48 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:48 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:19:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Deleted volume successfully. Jul 08 16:19:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f6b0af84-de76-4c29-9dbc-be84f4d12b65 tempest-VolumesTransfersV357Test-1368435528 None] Lock "cinder-3f9d768c-c62f-4e61-8d03-463fade4b44f-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:19:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0877c9-518c-46c1-8063-4af591924458]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:50 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 Jul 08 16:19:50 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:51 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208" returned: 0 in 0.892s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '328d195f-737a-41b0-b452-3f174f78faab', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:19:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-1dafab9e-8826-469b-86d3-6bc6b5354c73 req-d5536508-5fac-4135-9c4a-0694a76a93b9 tempest-AttachVolumeNegativeTest-2005293778 None] attachment_update completed successfully. Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Flow 'volume_create_manager' (85c8e78b-afcf-4a76-9aa1-321302f76285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ced052-7ec0-44a1-912b-9276b8d3c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ced052-7ec0-44a1-912b-9276b8d3c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-424018259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a944cb-4568-4c23-b4a8-c8167d3920e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64dd8f682e449f8c1ca61a10e3d854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:52Z,use_quota=True,user_id='dd3f6955560b482180a4896430aa1d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d1d846-23e3-4f47-9b1c-a3b329d436cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d1d846-23e3-4f47-9b1c-a3b329d436cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314cefd9-e27d-4636-9268-020e6172db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:51 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314cefd9-e27d-4636-9268-020e6172db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60a944cb-4568-4c23-b4a8-c8167d3920e1', 'volume_name': 'volume-60a944cb-4568-4c23-b4a8-c8167d3920e1', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa0719-da0f-4fa7-9e71-1092c7b0a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa0719-da0f-4fa7-9e71-1092c7b0a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bc1eeb-c3d4-4e27-9da0-056be9cc4374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Volume 60a944cb-4568-4c23-b4a8-c8167d3920e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60a944cb-4568-4c23-b4a8-c8167d3920e1', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Trying to clone 60a944cb-4568-4c23-b4a8-c8167d3920e1 from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:19:52 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Image download 20.69 MB at 20.69 MB/s Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dec2cbb-8d01-49cf-af62-2fca7f6ffa3c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:53 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD Jul 08 16:19:53 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:53 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD" returned: 0 in 0.805s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:53 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 is fetched for user dd3f6955560b482180a4896430aa1d52. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:19:53 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[58741576-a416-4bea-a8c5-4a8e80e95e3f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:53 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD Jul 08 16:19:53 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:54 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD" returned: 0 in 0.993s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-424018259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a944cb-4568-4c23-b4a8-c8167d3920e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64dd8f682e449f8c1ca61a10e3d854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:52Z,use_quota=True,user_id='dd3f6955560b482180a4896430aa1d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Creating volume 60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:54 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:54 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1073741824 Jul 08 16:19:54 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Flow 'volume_create_manager' (65468130-0a98-4466-af59-d275ced330b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f5af6-bed5-4a03-8399-197d021e038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f5af6-bed5-4a03-8399-197d021e038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1887031512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9652d5be-062f-498d-838e-d989959c230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a90b6e19644359a026771b49a551dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:55Z,use_quota=True,user_id='3ced64112b6040329aebdb0b8900148d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ed6d4b-65a8-40c5-bce4-1b52d040349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ed6d4b-65a8-40c5-bce4-1b52d040349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e453cf9-89ca-43ac-b41d-47d6d3b4b5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e453cf9-89ca-43ac-b41d-47d6d3b4b5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9652d5be-062f-498d-838e-d989959c230f', 'volume_name': 'volume-9652d5be-062f-498d-838e-d989959c230f', 'volume_size': 2}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fef3bbc-12e0-41db-8a3d-0d79b5b318af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fef3bbc-12e0-41db-8a3d-0d79b5b318af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e74572-6331-45b3-a404-28ecf6173f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Volume 9652d5be-062f-498d-838e-d989959c230f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9652d5be-062f-498d-838e-d989959c230f', 'volume_size': 2} Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:55 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1073741824" returned: 0 in 1.129s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:56 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:19:56 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:56 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 0.861s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1887031512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9652d5be-062f-498d-838e-d989959c230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a90b6e19644359a026771b49a551dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:19:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:19:55Z,use_quota=True,user_id='3ced64112b6040329aebdb0b8900148d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Creating volume 9652d5be-062f-498d-838e-d989959c230f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:19:56 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f 2147483648 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:56 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f 2147483648 Jul 08 16:19:56 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:56 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Attempting download of c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume 60a944cb-4568-4c23-b4a8-c8167d3920e1. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d39d1-ba91-4c1c-93ca-21257a58c8ee]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:57 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39 Jul 08 16:19:57 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:57 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:57 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39 Jul 08 16:19:57 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:57 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f 2147483648" returned: 0 in 1.033s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:58 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f Jul 08 16:19:58 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-afdbf0f9-b71c-4a0b-a68b-f62f59f606d1 req-2a993bc1-5bc0-4445-91e0-9be9960ab3b8 tempest-AttachVolumeNegativeTest-2005293778 None] Terminate volume connection completed successfully. Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-afdbf0f9-b71c-4a0b-a68b-f62f59f606d1 req-2a993bc1-5bc0-4445-91e0-9be9960ab3b8 tempest-AttachVolumeNegativeTest-2005293778 None] Deleting attachment 328d195f-737a-41b0-b452-3f174f78faab. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:19:58 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39" returned: 1 in 0.814s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_kzxt5i39' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[289e6a18-0838-4919-bea7-afa4ae3af5b4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:58 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD Jul 08 16:19:58 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:58 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e74572-6331-45b3-a404-28ecf6173f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9652d5be-062f-498d-838e-d989959c230f', 'volume_size': 2}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997d19c5-ea4e-4bf5-950f-8d9eac2ff19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:19:58 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Volume volume-9652d5be-062f-498d-838e-d989959c230f (9652d5be-062f-498d-838e-d989959c230f): created successfully Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997d19c5-ea4e-4bf5-950f-8d9eac2ff19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:19:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Flow 'volume_create_manager' (65468130-0a98-4466-af59-d275ced330b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:19:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ad2f7d42-968e-47a6-9d0b-f0f7acafd673 tempest-VolumesCloneNegativeTest-1532404048 None] Created volume successfully. Jul 08 16:19:59 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 was qcow2, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:59 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:19:59 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Acquiring lock "cinder-9652d5be-062f-498d-838e-d989959c230f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "cinder-9652d5be-062f-498d-838e-d989959c230f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Acquiring lock "cinder-quobyte-9652d5be-062f-498d-838e-d989959c230f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "cinder-quobyte-9652d5be-062f-498d-838e-d989959c230f" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5b7b70-430a-4a41-8778-0b9831f0ec17]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:19:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:19:59 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f Jul 08 16:19:59 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Acquiring lock "cinder-fa561aa9-8443-4780-b872-cf1453a1addd-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "cinder-fa561aa9-8443-4780-b872-cf1453a1addd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Acquiring lock "cinder-quobyte-fa561aa9-8443-4780-b872-cf1453a1addd" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "cinder-quobyte-fa561aa9-8443-4780-b872-cf1453a1addd" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db7cb30-2175-4403-bcaa-a2f73d1734a7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:00 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd Jul 08 16:20:00 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:01 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f" returned: 0 in 1.359s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:01 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f Jul 08 16:20:01 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:01 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd" returned: 0 in 1.273s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:02 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9652d5be-062f-498d-838e-d989959c230f" returned: 0 in 0.900s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:02 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd Jul 08 16:20:02 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "cinder-quobyte-9652d5be-062f-498d-838e-d989959c230f" released by "delete_volume" :: held 2.334s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Created reservations ['82c870cb-6499-4e81-9871-954bdebad8f5', '9f9df353-cf5e-4588-b1e5-c0d4ef64e6e4', '17ee6a93-b8c5-4897-bf32-41689fe69c8d', 'd93d6ccf-c1a5-4afc-a577-ca5411cc766c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.072s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:02 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 2.927s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:02 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:02 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3__vvw3raldevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:20:02 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Converted 112.00 MB image at 38.09 MB/s Jul 08 16:20:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:02 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1G Jul 08 16:20:02 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:03 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fa561aa9-8443-4780-b872-cf1453a1addd" returned: 0 in 1.490s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "cinder-quobyte-fa561aa9-8443-4780-b872-cf1453a1addd" released by "delete_volume" :: held 2.832s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Created reservations ['b4799072-0aad-46d3-a123-1100da8d01d1', 'a7b7400d-4387-479f-9d6c-d1fa6f9786c1', '1c17f971-a995-437f-8ced-3df922516dca', '7357e551-1acd-4c83-ad52-4be253580f53'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:03 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 1G" returned: 0 in 1.490s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:03 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:03 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:04 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:04 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Deleted volume successfully. Jul 08 16:20:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46c8492b-c127-4325-be23-76ce374111ae tempest-VolumesCloneNegativeTest-1532404048 None] Lock "cinder-9652d5be-062f-498d-838e-d989959c230f-delete_volume" released by "delete_volume" :: held 4.437s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[67790b83-2731-4068-bf2c-72da49a605a2]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:04 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:04 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:05 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.271s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:05 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Deleted volume successfully. Jul 08 16:20:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-715988fb-2b60-4093-a9e9-fded3db903b4 tempest-ServerRescueNegativeTestJSON-1436568311 None] Lock "cinder-fa561aa9-8443-4780-b872-cf1453a1addd-delete_volume" released by "delete_volume" :: held 4.605s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:05 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 1.630s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:05 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:05 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:07 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 1 in 1.270s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Downloaded image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume 60a944cb-4568-4c23-b4a8-c8167d3920e1 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 for user dd3f6955560b482180a4896430aa1d52 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Marking volume 60a944cb-4568-4c23-b4a8-c8167d3920e1 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Copying metadata from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 to 60a944cb-4568-4c23-b4a8-c8167d3920e1. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Creating volume glance metadata for volume 60a944cb-4568-4c23-b4a8-c8167d3920e1 backed by image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bc1eeb-c3d4-4e27-9da0-056be9cc4374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a944cb-4568-4c23-b4a8-c8167d3920e1', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe4401e-7816-4bcd-969c-2bc38b3cd008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:07 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Volume volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 (60a944cb-4568-4c23-b4a8-c8167d3920e1): created successfully Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe4401e-7816-4bcd-969c-2bc38b3cd008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Flow 'volume_create_manager' (85c8e78b-afcf-4a76-9aa1-321302f76285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-86688c38-6332-4a52-9408-00e0da42b0e9 tempest-VolumesExtendTest-1002457492 None] Created volume successfully. Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (10bcdd5c-fa04-40f0-8ab8-4b1816d52198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7fe4d3-88cb-4fc2-ac06-028d06a6c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7fe4d3-88cb-4fc2-ac06-028d06a6c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1299295022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:09Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5604c2a0-97b4-4781-b2f7-60cce7228640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5604c2a0-97b4-4781-b2f7-60cce7228640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c83512-6f8b-4acb-b3a6-487363c03fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c83512-6f8b-4acb-b3a6-487363c03fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc', 'volume_name': 'volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f325f3d4-f4dd-4200-8ab6-18c7f1ae69c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f325f3d4-f4dd-4200-8ab6-18c7f1ae69c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94105b22-95b2-4f8b-adf6-5db22566fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Volume c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc', 'volume_size': 1} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7add4-e7d7-4a12-a203-7c9ca2a23760]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:09 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:09 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:09 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 1.010s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:10 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:10 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-3ca3d0b7-dedf-4d05-acff-2c43759a9208-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-3ca3d0b7-dedf-4d05-acff-2c43759a9208-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-quobyte-3ca3d0b7-dedf-4d05-acff-2c43759a9208" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-3ca3d0b7-dedf-4d05-acff-2c43759a9208" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[08826738-b58b-4f65-a2ad-d74e21f7c3a3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:10 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 Jul 08 16:20:10 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:10 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 1 in 0.986s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:20:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 2G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 2G" returned: 0 in 0.088s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.163s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1299295022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:09Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Creating volume c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:11 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:11 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc 1073741824 Jul 08 16:20:11 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-329d4a05-6e65-46da-b53a-436460ff394a tempest-VolumesExtendTest-1002457492 None] Extend volume completed successfully. Jul 08 16:20:11 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208" returned: 0 in 0.888s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:11 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208 Jul 08 16:20:11 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:12 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc 1073741824" returned: 0 in 1.020s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:12 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc Jul 08 16:20:12 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:12 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3ca3d0b7-dedf-4d05-acff-2c43759a9208" returned: 0 in 0.873s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-60a944cb-4568-4c23-b4a8-c8167d3920e1-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-3ca3d0b7-dedf-4d05-acff-2c43759a9208" released by "delete_volume" :: held 1.860s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-60a944cb-4568-4c23-b4a8-c8167d3920e1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-quobyte-60a944cb-4568-4c23-b4a8-c8167d3920e1" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-60a944cb-4568-4c23-b4a8-c8167d3920e1" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Created reservations ['132f8060-0b00-48fd-9942-8621646eb8f1', '18ac8342-a6bc-43fe-8a6d-112ead1f12b1', '58b818fe-b76e-468f-ac89-36aea9b0253c', '9b605328-c381-4e7c-beb6-14ae54b0bb76'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d47026-29a0-483e-99d0-e8a9fec6e5fb]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:12 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:12 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:12 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:12 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-6925eb31-aa08-4408-90f1-86d7f79f22d3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-6925eb31-aa08-4408-90f1-86d7f79f22d3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-quobyte-6925eb31-aa08-4408-90f1-86d7f79f22d3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:13 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" returned: 0 in 1.003s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-6925eb31-aa08-4408-90f1-86d7f79f22d3" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94105b22-95b2-4f8b-adf6-5db22566fd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07349c4f-d51e-4248-b89c-a711601701e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[98624368-820a-4f97-9c61-69ad157849d6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:13 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Volume volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc (c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc): created successfully Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07349c4f-d51e-4248-b89c-a711601701e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (10bcdd5c-fa04-40f0-8ab8-4b1816d52198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dbda9853-819d-45bb-9b29-694367b36111 tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:20:13 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 Jul 08 16:20:13 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:13 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.826s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Deleted volume successfully. Jul 08 16:20:13 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 0.926s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0c80e906-76cf-48bf-9de0-5c419f652ac4 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-3ca3d0b7-dedf-4d05-acff-2c43759a9208-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:13 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:13 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:14 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:14 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3 Jul 08 16:20:14 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:14 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 1 in 0.885s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:14 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1 Jul 08 16:20:14 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:14 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6925eb31-aa08-4408-90f1-86d7f79f22d3" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-6925eb31-aa08-4408-90f1-86d7f79f22d3" released by "delete_volume" :: held 1.837s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=57,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=74,cinder:UPDATE=75,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Created reservations ['6cfe3175-60e4-4c24-b080-7205444e38b6', '62988c7c-7c8e-43c2-a479-6c58add3832f', '29f02e02-3fd9-45c8-a6da-8da69315a264', 'f5bc1b71-e04d-462d-b4ac-dbacda2c0034'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:15 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:15 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (b0484fc8-535b-4484-a688-b31e722e175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383e620e-05b7-486c-b09c-49fd195c7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383e620e-05b7-486c-b09c-49fd195c7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1184843804',display_name='tempest-VolumesGetTest-Volume-931193542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b5ea6e-6720-4ce1-be01-999d16442770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:15Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f2047a-685e-4b9e-b543-cc4196245b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f2047a-685e-4b9e-b543-cc4196245b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6808c462-9541-40ae-a55d-8afb9f5ae2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6808c462-9541-40ae-a55d-8afb9f5ae2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b5ea6e-6720-4ce1-be01-999d16442770', 'volume_name': 'volume-62b5ea6e-6720-4ce1-be01-999d16442770', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fd6851-6f06-4f3c-83f6-dc82885ecb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fd6851-6f06-4f3c-83f6-dc82885ecb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ae7a47-39d1-418a-b42b-ed450457efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Volume 62b5ea6e-6720-4ce1-be01-999d16442770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b5ea6e-6720-4ce1-be01-999d16442770', 'volume_size': 1} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1184843804',display_name='tempest-VolumesGetTest-Volume-931193542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b5ea6e-6720-4ce1-be01-999d16442770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:15Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Creating volume 62b5ea6e-6720-4ce1-be01-999d16442770 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:15 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:15 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-60a944cb-4568-4c23-b4a8-c8167d3920e1" returned: 0 in 1.136s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:15 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 1073741824 Jul 08 16:20:15 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-60a944cb-4568-4c23-b4a8-c8167d3920e1" released by "delete_volume" :: held 3.091s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-441c18c1-a638-4d44-9c58-375e5c039d0f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Created reservations ['24e6c45b-9bf2-4248-abd9-9effb0cf53c6', 'cc77e11a-ee6b-450d-a4de-8137fc476326', '6bd8029f-8a21-4bdf-8dad-219dbb393c8a', 'c572cb49-2d81-497f-9dd0-897cd9bc9965'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-441c18c1-a638-4d44-9c58-375e5c039d0f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "cinder-quobyte-441c18c1-a638-4d44-9c58-375e5c039d0f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-441c18c1-a638-4d44-9c58-375e5c039d0f" acquired by "delete_volume" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05f8d88-2c67-4dbd-88ee-f0de73a83358]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:15 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:15 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:16 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f Jul 08 16:20:16 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:16 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.131s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Deleted volume successfully. Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fe1002f8-814f-4df4-a37b-d26d67ce6482 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-6925eb31-aa08-4408-90f1-86d7f79f22d3-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:16 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 1073741824" returned: 0 in 1.158s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:16 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 Jul 08 16:20:16 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:16 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.926s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Deleted volume successfully. Jul 08 16:20:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d0f3012a-9823-4c52-9157-3495c7bf9666 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-60a944cb-4568-4c23-b4a8-c8167d3920e1-delete_volume" released by "delete_volume" :: held 4.469s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:17 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f" returned: 0 in 1.158s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:17 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f Jul 08 16:20:17 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:17 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Flow 'volume_create_manager' (6730a87d-d8b8-4e02-8120-692fe2d8e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26269ca-82bd-4b72-a312-bbc318eed691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770" returned: 0 in 0.819s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26269ca-82bd-4b72-a312-bbc318eed691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1008895297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02a55dd-666c-4dad-b011-9b4da6d701b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64dd8f682e449f8c1ca61a10e3d854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:17Z,use_quota=True,user_id='dd3f6955560b482180a4896430aa1d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6aaff7-9583-433b-b361-5140e092e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6aaff7-9583-433b-b361-5140e092e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64c89c9-829b-4584-b96d-894b97b37422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64c89c9-829b-4584-b96d-894b97b37422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02a55dd-666c-4dad-b011-9b4da6d701b7', 'volume_name': 'volume-e02a55dd-666c-4dad-b011-9b4da6d701b7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e02802-0a3b-4803-bf3f-0913328a0286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e02802-0a3b-4803-bf3f-0913328a0286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4789ba-a496-4d03-afe8-70e6b25cf642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Volume e02a55dd-666c-4dad-b011-9b4da6d701b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02a55dd-666c-4dad-b011-9b4da6d701b7', 'volume_size': 1} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1008895297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02a55dd-666c-4dad-b011-9b4da6d701b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64dd8f682e449f8c1ca61a10e3d854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:17Z,use_quota=True,user_id='dd3f6955560b482180a4896430aa1d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Creating volume e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:17 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ae7a47-39d1-418a-b42b-ed450457efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b5ea6e-6720-4ce1-be01-999d16442770', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3939f12d-0ded-46cc-94ab-aba5e2210e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:17 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 1073741824 Jul 08 16:20:17 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Volume volume-62b5ea6e-6720-4ce1-be01-999d16442770 (62b5ea6e-6720-4ce1-be01-999d16442770): created successfully Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3939f12d-0ded-46cc-94ab-aba5e2210e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (b0484fc8-535b-4484-a688-b31e722e175d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cf42a933-59a4-4a61-9d8f-9cbba2afcbec tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:20:17 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-441c18c1-a638-4d44-9c58-375e5c039d0f" returned: 0 in 0.734s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-quobyte-441c18c1-a638-4d44-9c58-375e5c039d0f" released by "delete_volume" :: held 1.955s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:17 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Created reservations ['0e4f3211-8b10-4511-a0ce-9e3b062b51a4', 'b258a87b-3705-4f3d-a119-d6827154773b', '0e7c4ee0-e58f-4c51-85f6-62321a8ac9b6', 'f7d9cf40-2400-4360-9869-5298a3e39368'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:18 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:18 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:18 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 1073741824" returned: 0 in 0.986s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:18 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:18 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-62b5ea6e-6720-4ce1-be01-999d16442770-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "cinder-62b5ea6e-6720-4ce1-be01-999d16442770-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-62b5ea6e-6720-4ce1-be01-999d16442770" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:18 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.868s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-62b5ea6e-6720-4ce1-be01-999d16442770" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Deleted volume successfully. Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1857132-8feb-4746-a149-98813ebee035]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c5949dbb-8d3a-43ea-9b63-340a58d75a75 tempest-AttachVolumeNegativeTest-2005293778 None] Lock "cinder-441c18c1-a638-4d44-9c58-375e5c039d0f-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:19 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 Jul 08 16:20:19 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:20:19 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.774s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4789ba-a496-4d03-afe8-70e6b25cf642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02a55dd-666c-4dad-b011-9b4da6d701b7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcdfc75-ba7f-4f8a-b462-8367e275a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:19 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Volume volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 (e02a55dd-666c-4dad-b011-9b4da6d701b7): created successfully Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcdfc75-ba7f-4f8a-b462-8367e275a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Flow 'volume_create_manager' (6730a87d-d8b8-4e02-8120-692fe2d8e51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6937da1f-fe9a-40a6-8da6-efdb8432d8f6 tempest-VolumesExtendTest-1002457492 None] Created volume successfully. Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Creating offline snapshot 7db82467-5da8-4d31-8517-deb6151a7fc9 of volume e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:20:19 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770" returned: 0 in 0.980s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e078f9-03ac-4f4c-b279-255d3c13529e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:19 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770 Jul 08 16:20:19 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:20 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:20 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:20 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-62b5ea6e-6720-4ce1-be01-999d16442770" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-62b5ea6e-6720-4ce1-be01-999d16442770" released by "delete_volume" :: held 1.802s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Created reservations ['f91b62bc-5c00-4bfd-90e2-626c67e434d5', '31988aaa-9bb3-458b-84b6-e12965745799', '9911707e-7075-4614-bc65-a329985b25c9', 'eba94f9e-5c45-4f14-ba9d-2050d351cb2d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:20 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:20 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:20 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:20 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 1G Jul 08 16:20:20 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "cinder-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713895a-388a-4bad-b30b-46c8dcb3d1f1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:21 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc Jul 08 16:20:21 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:21 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.118s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:20:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-530c0ca7-f149-43a6-8fe2-c9bc4fefbb54 tempest-VolumesGetTest-1198920591 None] Lock "cinder-62b5ea6e-6720-4ce1-be01-999d16442770-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:22 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 1G" returned: 0 in 1.202s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:22 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 Jul 08 16:20:22 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:22 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" returned: 0 in 1.121s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:22 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc Jul 08 16:20:22 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:23 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9" returned: 0 in 0.929s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:23 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 is being set with open permissions: ugo+rw Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:23 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 Jul 08 16:20:23 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:23 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" returned: 0 in 0.908s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc" released by "delete_volume" :: held 2.098s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Created reservations ['0ef3b128-ad9e-45a3-92f6-aa8166a8c093', '78d6a173-9566-4c66-8c5b-dcf43d554d4e', '6df9a086-adbc-4124-b537-80d06dafaeea', '02d52020-7389-4950-b0ba-995f6ebdc912'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:23 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:23 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:24 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:24 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info Jul 08 16:20:24 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:24 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-47c5f364-9ac9-4d6d-a8d5-06610a647ff9 tempest-VolumesGetTest-1198920591 None] Lock "cinder-c372e5bb-ad3d-4814-9da0-bd0dae9ca0bc-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:24 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info" returned: 0 in 0.771s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:24 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info is being set with open permissions: ugo+rw Jul 08 16:20:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:24 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info Jul 08 16:20:24 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (ceaa3b9a-c1e0-4522-806d-e35a489b0251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e324d498-a027-41dc-b3c3-0e10d8c3c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e324d498-a027-41dc-b3c3-0e10d8c3c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552973783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4feea9-fad2-4ff2-90c1-52bbe04b299c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:25Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9991fe-70eb-4ae4-a93b-69f44be8086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9991fe-70eb-4ae4-a93b-69f44be8086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978e1ffe-3860-4a17-9552-439972d4a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978e1ffe-3860-4a17-9552-439972d4a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'volume_name': 'volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ad5181-c7f0-4d23-bd18-530d91440b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ad5181-c7f0-4d23-bd18-530d91440b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f29e1a8-623d-4ddc-9a4b-d06f0a84dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Volume ab4feea9-fad2-4ff2-90c1-52bbe04b299c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'volume_size': 1} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:25 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.info" returned: 0 in 0.928s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.921s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552973783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4feea9-fad2-4ff2-90c1-52bbe04b299c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:25Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Creating volume ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:25 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:25 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c 1073741824 Jul 08 16:20:25 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4e8e3904-8f9e-41f2-b391-33c9e66e7f0d tempest-VolumesExtendTest-1002457492 None] Create snapshot completed successfully Jul 08 16:20:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:26 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c 1073741824" returned: 0 in 1.083s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:26 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:20:26 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (fba1abf5-a356-4084-ae61-842fd3ed8bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6674a1b0-ee98-4934-9469-bf1bb36d591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6674a1b0-ee98-4934-9469-bf1bb36d591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321725202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98460e38-1cae-41a4-899a-4351b8460219,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:27Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8329d147-f490-4d25-9880-eceeb9afacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8329d147-f490-4d25-9880-eceeb9afacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f5d09e-2f0d-4874-bb9f-3bb3c4f3c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f5d09e-2f0d-4874-bb9f-3bb3c4f3c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98460e38-1cae-41a4-899a-4351b8460219', 'volume_name': 'volume-98460e38-1cae-41a4-899a-4351b8460219', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5fdcbd-1f82-447d-a05a-ec33f06e7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5fdcbd-1f82-447d-a05a-ec33f06e7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a27c78-50f3-41dd-8edb-1606625f0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Volume 98460e38-1cae-41a4-899a-4351b8460219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98460e38-1cae-41a4-899a-4351b8460219', 'volume_size': 1} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:27 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.199s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f29e1a8-623d-4ddc-9a4b-d06f0a84dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd003d8-9332-465f-8306-bb21c0ae8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc181f3-f92b-428c-9b43-5d9ccd29364a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:27 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Volume volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c (ab4feea9-fad2-4ff2-90c1-52bbe04b299c): created successfully Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd003d8-9332-465f-8306-bb21c0ae8321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (ceaa3b9a-c1e0-4522-806d-e35a489b0251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-06e06368-367e-4323-becd-9bf0620cbcec tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:20:27 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:27 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:28 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.792s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 2G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 2G" returned: 0 in 0.144s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.981s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321725202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98460e38-1cae-41a4-899a-4351b8460219,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:27Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Creating volume 98460e38-1cae-41a4-899a-4351b8460219 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:28 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:28 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-985111bc-3863-4c3c-9901-968e9feafa7a tempest-VolumesExtendTest-1002457492 None] Extend volume completed successfully. Jul 08 16:20:28 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 1073741824 Jul 08 16:20:28 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (233fcb59-7201-4f2b-b58b-e76bbf5b718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e560e9-8fe9-470b-98bd-e0867494d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e560e9-8fe9-470b-98bd-e0867494d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1215741142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f075e9-1f3e-425b-9535-07918a372d6f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ab4feea9-fad2-4ff2-90c1-52bbe04b299c,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:29Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6447f042-58bc-416e-8519-67e59561b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6447f042-58bc-416e-8519-67e59561b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4b353c-7194-44ca-bd7b-f2e52d523de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4b353c-7194-44ca-bd7b-f2e52d523de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03f075e9-1f3e-425b-9535-07918a372d6f', 'volume_name': 'volume-03f075e9-1f3e-425b-9535-07918a372d6f', 'volume_size': 1, 'source_volid': 'ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'source_volstatus': 'available'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e301db2-1b39-4317-9b16-1d707f4a4008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e301db2-1b39-4317-9b16-1d707f4a4008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d1e6d4-cce6-4b69-ba21-70411ccf94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Volume 03f075e9-1f3e-425b-9535-07918a372d6f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03f075e9-1f3e-425b-9535-07918a372d6f', 'volume_size': 1, 'source_volid': 'ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'source_volstatus': 'available'} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:29 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 1073741824" returned: 0 in 1.004s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:29 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 Jul 08 16:20:29 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-7db82467-5da8-4d31-8517-deb6151a7fc9-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-7db82467-5da8-4d31-8517-deb6151a7fc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-quobyte-7db82467-5da8-4d31-8517-deb6151a7fc9" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-7db82467-5da8-4d31-8517-deb6151a7fc9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Deleting offline snapshot 7db82467-5da8-4d31-8517-deb6151a7fc9 of volume e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] snapshot_file for this snap is: volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1d8a7-e909-4252-ae30-76867b20ac05]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:30 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 Jul 08 16:20:30 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:30 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.997s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:30 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Cloning volume ab4feea9-fad2-4ff2-90c1-52bbe04b299c to volume 03f075e9-1f3e-425b-9535-07918a372d6f Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a27c78-50f3-41dd-8edb-1606625f0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98460e38-1cae-41a4-899a-4351b8460219', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a021ba2-21e2-4dd1-80a0-2ccc41251dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:30 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Volume volume-98460e38-1cae-41a4-899a-4351b8460219 (98460e38-1cae-41a4-899a-4351b8460219): created successfully Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a021ba2-21e2-4dd1-80a0-2ccc41251dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (fba1abf5-a356-4084-ae61-842fd3ed8bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Creating offline snapshot f68ee968-2477-49a8-87c6-fdd48a408da6 of volume ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:20:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3e1c3421-5da6-4caa-bfc3-e9e564623363 tempest-VolumesTestJSON-1799198905 None] Created volume successfully. Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f4d69d-5d26-479e-80cf-8044847ddc65]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:30 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:20:30 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:30 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9" returned: 0 in 0.859s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02a55dd-666c-4dad-b011-9b4da6d701b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3fc0a2-c316-49d2-ab91-29fa6598bf86]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:31 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:31 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:31 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 0.878s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:31 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 1G Jul 08 16:20:31 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:31 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.926s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:31 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 Jul 08 16:20:31 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (6c3c1727-ae6d-43d1-a3df-8ea3f6ab651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf5153-59c7-41b7-95b3-8b2d27086b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf5153-59c7-41b7-95b3-8b2d27086b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-824905059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149d3a28-7ae6-4d85-97d2-da0556c72e89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:32Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87f666a-c4b2-4859-9617-f16f54665d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87f666a-c4b2-4859-9617-f16f54665d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd06f97-44b8-4bf3-b27c-5ce96c059694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd06f97-44b8-4bf3-b27c-5ce96c059694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149d3a28-7ae6-4d85-97d2-da0556c72e89', 'volume_name': 'volume-149d3a28-7ae6-4d85-97d2-da0556c72e89', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732ce4f-2324-4c52-a7f3-2edd3a1831f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732ce4f-2324-4c52-a7f3-2edd3a1831f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0875df-c8aa-4b9c-a9ae-8dc135b07fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Volume 149d3a28-7ae6-4d85-97d2-da0556c72e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149d3a28-7ae6-4d85-97d2-da0556c72e89', 'volume_size': 1} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:32 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 1G" returned: 0 in 0.966s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:32 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:32 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:32 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:32 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9 Jul 08 16:20:32 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:33 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:33 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 is being set with open permissions: ugo+rw Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:33 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:33 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:33 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7.7db82467-5da8-4d31-8517-deb6151a7fc9" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-7db82467-5da8-4d31-8517-deb6151a7fc9" released by "_delete_snapshot" :: held 3.589s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" released by "delete_snapshot" :: held 3.614s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Created reservations ['2f339cee-15ac-4860-aee7-d669b9d8a8ab', '33c8cf06-856d-4605-8c53-54e12a229a64', '253adeb6-e30d-432e-b5be-724f455cd6c6', '1f70acbc-288b-43aa-8271-017c8dd0e437'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Delete snapshot completed successfully. Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-09740483-2150-4779-b273-4d565f1b51bc tempest-VolumesExtendTest-1002457492 None] Lock "cinder-7db82467-5da8-4d31-8517-deb6151a7fc9-delete_snapshot" released by "delete_snapshot" :: held 3.767s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:33 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 0.744s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:33 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info Jul 08 16:20:33 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-e02a55dd-666c-4dad-b011-9b4da6d701b7-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-e02a55dd-666c-4dad-b011-9b4da6d701b7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff370ed2-f41b-44d4-b502-ca4a9d0276d2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:34 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:34 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:34 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:34 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info is being set with open permissions: ugo+rw Jul 08 16:20:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:34 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info Jul 08 16:20:34 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:35 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.927s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:35 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7 Jul 08 16:20:35 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:35 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.info" returned: 0 in 0.792s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] snapshot: f68ee968-2477-49a8-87c6-fdd48a408da6, volume: 03f075e9-1f3e-425b-9535-07918a372d6f, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a27183-c89c-4106-9801-3e4ef12e89d8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:35 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:35 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:36 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e02a55dd-666c-4dad-b011-9b4da6d701b7" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-quobyte-e02a55dd-666c-4dad-b011-9b4da6d701b7" released by "delete_volume" :: held 1.796s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Created reservations ['709a3c7a-014a-4171-9750-67ee5e39e22f', '995a46af-761b-4bc7-a1ad-25a91e60921d', 'bc4d0392-66b7-4397-a0f7-79710679df46', '361a082a-a735-42b1-bbe7-18d86e9b11a5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:36 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:36 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:36 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 1.082s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc018dc-8ac2-4c25-9e0e-3f29ec2fcc7f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:37 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:20:37 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:37 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.830s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Deleted volume successfully. Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-07d0e058-6468-4ea2-8df6-9e9919932e08 tempest-VolumesExtendTest-1002457492 None] Lock "cinder-e02a55dd-666c-4dad-b011-9b4da6d701b7-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:37 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 1.125s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:20:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:37 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f Jul 08 16:20:37 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Flow 'volume_create_manager' (1cefd91b-7a29-49aa-8d9d-5149db3723ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51042c3a-67b2-4eb0-abd6-b3e2bb4b91fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51042c3a-67b2-4eb0-abd6-b3e2bb4b91fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1756160541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882cc32f-64e2-4547-b9e7-bcfa5793b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e31928c57804b33a8a5ecaf5e8eed51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:44Z,use_quota=True,user_id='0536d850d8dc409db87b101cd30b09c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d659f-bdd1-42e7-b97c-4ee38a08ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d659f-bdd1-42e7-b97c-4ee38a08ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad2b512-5879-4685-8e74-a89be07224f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad2b512-5879-4685-8e74-a89be07224f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882cc32f-64e2-4547-b9e7-bcfa5793b3d0', 'volume_name': 'volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8029961f-6bd1-4b36-80ac-708554a53f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8029961f-6bd1-4b36-80ac-708554a53f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94e8070-02d3-4211-9eed-0ede611541ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Volume 882cc32f-64e2-4547-b9e7-bcfa5793b3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0', 'volume_size': 1} Jul 08 16:20:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:44 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f" returned: 0 in 6.289s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea942e-b172-4efd-8759-21f92e16437e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:44 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:20:44 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:45 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 0.948s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:20:45 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Converted 1024.00 MB image at 162.80 MB/s Jul 08 16:20:45 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f is being set with open permissions: ugo+rw Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:45 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f Jul 08 16:20:45 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:45 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f" returned: 0 in 0.632s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" released by "_copy_volume_from_snapshot" :: held 10.210s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-f68ee968-2477-49a8-87c6-fdd48a408da6" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-f68ee968-2477-49a8-87c6-fdd48a408da6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Deleting offline snapshot f68ee968-2477-49a8-87c6-fdd48a408da6 of volume ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] snapshot_file for this snap is: volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[41071cf5-44d5-4fd6-9cce-b4bad2d958a4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:45 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:45 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:46 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 0.762s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:20:46 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e5536-5db0-4c13-93f2-2435cdab736f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:46 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:20:46 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:47 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 0.816s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:47 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:47 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:48 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 0.740s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:48 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6 Jul 08 16:20:48 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:48 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c.f68ee968-2477-49a8-87c6-fdd48a408da6" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-f68ee968-2477-49a8-87c6-fdd48a408da6" released by "_delete_snapshot" :: held 3.199s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.641s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.911s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-824905059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149d3a28-7ae6-4d85-97d2-da0556c72e89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:32Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Creating volume 149d3a28-7ae6-4d85-97d2-da0556c72e89 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:49 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d1e6d4-cce6-4b69-ba21-70411ccf94e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f075e9-1f3e-425b-9535-07918a372d6f', 'volume_size': 1, 'source_volid': 'ab4feea9-fad2-4ff2-90c1-52bbe04b299c', 'source_volstatus': 'available'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:49 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 1073741824 Jul 08 16:20:49 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa49370-f3eb-4f43-b6d5-f6fb79f9c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Volume volume-03f075e9-1f3e-425b-9535-07918a372d6f (03f075e9-1f3e-425b-9535-07918a372d6f): created successfully Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa49370-f3eb-4f43-b6d5-f6fb79f9c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (233fcb59-7201-4f2b-b58b-e76bbf5b718d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3970e695-409c-4c38-a276-1b210c671434 tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:20:50 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 1073741824" returned: 0 in 0.972s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:50 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 Jul 08 16:20:50 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:50 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89" returned: 0 in 0.695s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.856s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1756160541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882cc32f-64e2-4547-b9e7-bcfa5793b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e31928c57804b33a8a5ecaf5e8eed51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:44Z,use_quota=True,user_id='0536d850d8dc409db87b101cd30b09c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Creating volume 882cc32f-64e2-4547-b9e7-bcfa5793b3d0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:50 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:50 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 1073741824 Jul 08 16:20:50 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0875df-c8aa-4b9c-a9ae-8dc135b07fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149d3a28-7ae6-4d85-97d2-da0556c72e89', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313693b2-3fa3-4dbe-9b0c-2af17784fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Volume volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 (149d3a28-7ae6-4d85-97d2-da0556c72e89): created successfully Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313693b2-3fa3-4dbe-9b0c-2af17784fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (6c3c1727-ae6d-43d1-a3df-8ea3f6ab651c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e643ca5f-408c-41c2-99d5-2c835a878545 tempest-VolumesTestJSON-1799198905 None] Created volume successfully. Jul 08 16:20:50 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (429effbc-cbc4-4b9f-83c9-1202d616785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44a6a57-4a94-4606-b232-ab4e966fcd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44a6a57-4a94-4606-b232-ab4e966fcd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1548038532',display_name='tempest-VolumesGetTest-Volume-2118316026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c550f53-5ada-42df-b4a0-c93575b894cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:51Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66748f31-7aa4-460d-8348-59921493db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66748f31-7aa4-460d-8348-59921493db1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2e543c-bccb-4bc6-ad9b-c9b447b43314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2e543c-bccb-4bc6-ad9b-c9b447b43314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c550f53-5ada-42df-b4a0-c93575b894cd', 'volume_name': 'volume-7c550f53-5ada-42df-b4a0-c93575b894cd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c443472-c39e-43fe-b678-29c7635912dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c443472-c39e-43fe-b678-29c7635912dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2109719-aaf4-4d63-9352-528ab09f9802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Volume 7c550f53-5ada-42df-b4a0-c93575b894cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c550f53-5ada-42df-b4a0-c93575b894cd', 'volume_size': 1} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:51 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 1073741824" returned: 0 in 0.886s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:51 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 Jul 08 16:20:51 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (e0db41c2-8a84-4e3a-a75a-610a1f265e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b6721b-fb94-4478-b45b-05d2d71d0183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b6721b-fb94-4478-b45b-05d2d71d0183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027668288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf06222-30c5-448e-acdb-274f33e8f7c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:52Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a5a40a-a4fe-4b18-b786-15a2f21aac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a5a40a-a4fe-4b18-b786-15a2f21aac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85802138-2f50-44f4-9a2e-17908cff9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85802138-2f50-44f4-9a2e-17908cff9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf06222-30c5-448e-acdb-274f33e8f7c1', 'volume_name': 'volume-adf06222-30c5-448e-acdb-274f33e8f7c1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d6615-b2cd-4732-8dd6-05d0c881b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d6615-b2cd-4732-8dd6-05d0c881b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7cf27a-f845-43bc-abde-a3c91e97c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Volume adf06222-30c5-448e-acdb-274f33e8f7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf06222-30c5-448e-acdb-274f33e8f7c1', 'volume_size': 1} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1548038532',display_name='tempest-VolumesGetTest-Volume-2118316026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c550f53-5ada-42df-b4a0-c93575b894cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:51Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Creating volume 7c550f53-5ada-42df-b4a0-c93575b894cd {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:52 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:52 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd 1073741824 Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94e8070-02d3-4211-9eed-0ede611541ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fc4030-9cdd-432f-a776-adbdf0144b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Volume volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 (882cc32f-64e2-4547-b9e7-bcfa5793b3d0): created successfully Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fc4030-9cdd-432f-a776-adbdf0144b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Flow 'volume_create_manager' (1cefd91b-7a29-49aa-8d9d-5149db3723ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3c951434-a2eb-4720-80e2-13bfd301aa32 tempest-VolumesNegativeTest-136890357 None] Created volume successfully. Jul 08 16:20:53 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd 1073741824" returned: 0 in 1.112s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:53 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd Jul 08 16:20:53 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:54 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd" returned: 0 in 0.905s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027668288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf06222-30c5-448e-acdb-274f33e8f7c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb21c5d1f13f4a0695ebdc370e394939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:20:52Z,use_quota=True,user_id='de57d60bca2740878ae5d09c33e05327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Creating volume adf06222-30c5-448e-acdb-274f33e8f7c1 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:20:54 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:54 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 1073741824 Jul 08 16:20:54 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2109719-aaf4-4d63-9352-528ab09f9802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c550f53-5ada-42df-b4a0-c93575b894cd', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bf0a0c-08ac-4db3-b0e3-d616f60cf3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Volume volume-7c550f53-5ada-42df-b4a0-c93575b894cd (7c550f53-5ada-42df-b4a0-c93575b894cd): created successfully Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bf0a0c-08ac-4db3-b0e3-d616f60cf3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (429effbc-cbc4-4b9f-83c9-1202d616785a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cb1669dc-cef2-4777-922d-ef44cd2fc6f2 tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-7c550f53-5ada-42df-b4a0-c93575b894cd-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "cinder-7c550f53-5ada-42df-b4a0-c93575b894cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-7c550f53-5ada-42df-b4a0-c93575b894cd" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:55 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 1073741824" returned: 0 in 1.020s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-7c550f53-5ada-42df-b4a0-c93575b894cd" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62a49c-6905-4768-baa7-0e6d573bdb60]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:55 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 Jul 08 16:20:55 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:55 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd Jul 08 16:20:55 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:56 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1" returned: 0 in 0.848s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7cf27a-f845-43bc-abde-a3c91e97c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf06222-30c5-448e-acdb-274f33e8f7c1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30e38cd-e9f3-446a-8793-19fe5f916fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:20:56 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd" returned: 0 in 0.956s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Volume volume-adf06222-30c5-448e-acdb-274f33e8f7c1 (adf06222-30c5-448e-acdb-274f33e8f7c1): created successfully Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30e38cd-e9f3-446a-8793-19fe5f916fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:20:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Flow 'volume_create_manager' (e0db41c2-8a84-4e3a-a75a-610a1f265e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:20:56 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd Jul 08 16:20:56 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-211ad6dd-0241-4cf4-8e33-7b93b06e5053 tempest-VolumesTestJSON-1799198905 None] Created volume successfully. Jul 08 16:20:57 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7c550f53-5ada-42df-b4a0-c93575b894cd" returned: 0 in 0.755s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-7c550f53-5ada-42df-b4a0-c93575b894cd" released by "delete_volume" :: held 1.759s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Created reservations ['fe27a15c-520c-4359-971b-8c20cb16c034', '0ea2bb11-7da6-4e0d-bda5-125b091d5757', '6f4a8111-bf3b-4c19-83bf-f3c8e9f2709f', 'f220a3ab-736a-42b5-8bcf-620c25a67121'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:20:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:57 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:20:57 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-03f075e9-1f3e-425b-9535-07918a372d6f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "cinder-03f075e9-1f3e-425b-9535-07918a372d6f-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a07ef-e428-4026-9714-46dfbb94d2c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:58 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f Jul 08 16:20:58 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:58 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.390s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:20:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:20:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0a5ab706-d5e0-4410-ae44-75590c59f7e5 tempest-VolumesGetTest-1198920591 None] Lock "cinder-7c550f53-5ada-42df-b4a0-c93575b894cd-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:20:59 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 08 16:20:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f" returned: 0 in 1.274s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:20:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:20:59 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f Jul 08 16:20:59 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:20:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-adf06222-30c5-448e-acdb-274f33e8f7c1-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:20:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-adf06222-30c5-448e-acdb-274f33e8f7c1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-quobyte-adf06222-30c5-448e-acdb-274f33e8f7c1" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-adf06222-30c5-448e-acdb-274f33e8f7c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b4f59-b2c2-46f3-8f5a-9288462322a7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:00 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 Jul 08 16:21:00 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:01 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-03f075e9-1f3e-425b-9535-07918a372d6f" returned: 0 in 1.627s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-03f075e9-1f3e-425b-9535-07918a372d6f" released by "delete_volume" :: held 2.986s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Created reservations ['a41dd40d-944d-48c3-bcd5-9e2eb64c68f2', '3742c91b-e5e7-47c3-a113-b0f6dd7634d4', '05243632-cbd4-4748-a673-5cedc5bbf822', '2347841a-c460-4af9-bbb0-d62cc933a50f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:01 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1" returned: 0 in 1.514s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:01 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1 Jul 08 16:21:01 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:01 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:01 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-ab4feea9-fad2-4ff2-90c1-52bbe04b299c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "cinder-ab4feea9-fad2-4ff2-90c1-52bbe04b299c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a8ab1-ba81-4257-9641-b391b8f4da5a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:02 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:21:02 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:02 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-adf06222-30c5-448e-acdb-274f33e8f7c1" returned: 0 in 1.101s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-adf06222-30c5-448e-acdb-274f33e8f7c1" released by "delete_volume" :: held 2.703s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Created reservations ['59ee719d-e055-4450-bed3-362cdbaa2f67', 'ad00f468-4207-4c18-8745-250d507a71a7', '5653d2f1-caa6-4580-8a04-cafc117feb2d', 'e277f388-edf9-40c5-86ef-7c23d84493ca'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:03 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:03 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-149d3a28-7ae6-4d85-97d2-da0556c72e89-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-149d3a28-7ae6-4d85-97d2-da0556c72e89-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:03 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.966s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-quobyte-149d3a28-7ae6-4d85-97d2-da0556c72e89" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-149d3a28-7ae6-4d85-97d2-da0556c72e89" acquired by "delete_volume" :: waited 0.055s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf600f16-2a87-4ff4-b11e-e95fa236eba2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-635d86c2-bbc6-4805-9268-8e2390f10958 tempest-VolumesGetTest-1198920591 None] Lock "cinder-03f075e9-1f3e-425b-9535-07918a372d6f-delete_volume" released by "delete_volume" :: held 5.717s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:04 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 Jul 08 16:21:04 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:04 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.119s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:04 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Deleted volume successfully. Jul 08 16:21:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c91e72d-8c29-43d4-a6d5-91af7ccbaf42 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-adf06222-30c5-448e-acdb-274f33e8f7c1-delete_volume" released by "delete_volume" :: held 4.422s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:04 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 2.045s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:04 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c Jul 08 16:21:04 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:05 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89" returned: 0 in 1.126s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:05 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89 Jul 08 16:21:05 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:05 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" returned: 0 in 0.804s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-ab4feea9-fad2-4ff2-90c1-52bbe04b299c" released by "delete_volume" :: held 2.984s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Created reservations ['49434a33-01be-4731-a615-b55e72647756', 'b735a1eb-a1af-47f5-906a-d8e5c894fa71', '7cc715f8-ec97-4613-ac01-041ed6044433', '5c3abc43-5063-4c0e-b1d5-60e7539f5e2d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:05 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:05 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:06 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-149d3a28-7ae6-4d85-97d2-da0556c72e89" returned: 0 in 1.022s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-149d3a28-7ae6-4d85-97d2-da0556c72e89" released by "delete_volume" :: held 2.280s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Created reservations ['a562293a-04ac-4c78-8ca3-50243046e5d3', 'd1ac06a1-1231-49d3-9eb4-ed7c60ac0e1f', '59317e7d-03e8-4d62-8aff-fbb12b5f8bad', '3229fb74-5f2d-4bcd-9812-59cd510e3890'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:06 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:06 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:06 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.194s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:21:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-effebfa1-f81a-4795-afeb-861c013c70a1 tempest-VolumesGetTest-1198920591 None] Lock "cinder-ab4feea9-fad2-4ff2-90c1-52bbe04b299c-delete_volume" released by "delete_volume" :: held 4.600s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (f082b733-12d1-4917-b9e3-5938758fe741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f0ca2b-2ef3-4c70-8b35-bb3c73760ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f0ca2b-2ef3-4c70-8b35-bb3c73760ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-406895026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e5d402-2f0b-4405-b4ee-93afa4da6365,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:07Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1aeb81-900f-4ba2-aed6-36edf8937c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1aeb81-900f-4ba2-aed6-36edf8937c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507b811e-7478-40a5-996d-9c7298e90059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-98460e38-1cae-41a4-899a-4351b8460219-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-98460e38-1cae-41a4-899a-4351b8460219-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "cinder-quobyte-98460e38-1cae-41a4-899a-4351b8460219" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-98460e38-1cae-41a4-899a-4351b8460219" acquired by "delete_volume" :: waited 0.046s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8156a91f-109c-4152-8d7d-95bff1b826cd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:07 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 Jul 08 16:21:07 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:08 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.899s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Deleted volume successfully. Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507b811e-7478-40a5-996d-9c7298e90059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7e5d402-2f0b-4405-b4ee-93afa4da6365', 'volume_name': 'volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56eb683d-12b5-4b97-b470-3d22c79ed9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56eb683d-12b5-4b97-b470-3d22c79ed9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c44b166-c2d6-45d9-a8e1-a9b38015a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Volume b7e5d402-2f0b-4405-b4ee-93afa4da6365: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Trying to clone b7e5d402-2f0b-4405-b4ee-93afa4da6365 from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:21:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-834604f1-b25a-4d64-ab48-a8178d9ccca6 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-149d3a28-7ae6-4d85-97d2-da0556c72e89-delete_volume" released by "delete_volume" :: held 5.027s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:09 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219" returned: 0 in 1.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:09 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219 Jul 08 16:21:09 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:09 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:21:09 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Image download 20.69 MB at 20.69 MB/s Jul 08 16:21:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b42a387-6e7e-4861-ba1c-7aff1c28588f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:09 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD Jul 08 16:21:09 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:10 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-98460e38-1cae-41a4-899a-4351b8460219" returned: 0 in 1.206s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-quobyte-98460e38-1cae-41a4-899a-4351b8460219" released by "delete_volume" :: held 3.098s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Created reservations ['7290c0ba-ecd5-41cb-b145-1003f84f1b01', 'ee5e8362-b7ea-49bf-814e-182ac399713e', 'cd77a311-bfe7-4ed0-bde0-e314ddd44ed3', '63045fbb-cb8f-4dd7-83f9-9e957b0aee74'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:10 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:10 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:10 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD" returned: 0 in 1.172s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 is fetched for user ea3e733de94348228986704ec9b3bcf9. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ea2c1-abe6-4e84-81d7-4ff2c05657a9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:11 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD Jul 08 16:21:11 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:11 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.156s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:11 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Deleted volume successfully. Jul 08 16:21:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a9d1aa96-962a-4a54-b66f-68ce4d4ab4c1 tempest-VolumesTestJSON-1799198905 None] Lock "cinder-98460e38-1cae-41a4-899a-4351b8460219-delete_volume" released by "delete_volume" :: held 4.567s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:12 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD" returned: 0 in 1.160s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-406895026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e5d402-2f0b-4405-b4ee-93afa4da6365,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:07Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Creating volume b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:12 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:12 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1073741824 Jul 08 16:21:12 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:13 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1073741824" returned: 0 in 1.533s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:13 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:13 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:14 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 0 in 1.256s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] <== create_volume: return (2890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.897s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:14 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Attempting download of c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume b7e5d402-2f0b-4405-b4ee-93afa4da6365. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:21:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a169bbc0-82fc-4ff2-be6a-04c3a56f618a]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_ {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:15 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_ Jul 08 16:21:15 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:16 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_" returned: 0 in 1.018s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_ {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:16 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_ Jul 08 16:21:16 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:17 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_" returned: 1 in 1.631s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_lwc6qle_' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:21:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18f0e4-13b0-4064-9108-c75f8609c3e5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:17 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD Jul 08 16:21:17 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:18 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=99,cinder:INSERT=33,cinder:UPDATE=136,cinder:DELETE=10 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:21:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-87c18a59-a1ab-4e73-9466-6a1123374edf tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-1994664113: creating Jul 08 16:21:18 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=136,cinder:SELECT=87,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:21:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-87c18a59-a1ab-4e73-9466-6a1123374edf tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-1994664113: created successfully Jul 08 16:21:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-87c18a59-a1ab-4e73-9466-6a1123374edf tempest-GroupSnapshotsTest-1956020108 None] Create group completed successfully. Jul 08 16:21:18 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:18 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 was qcow2, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:21:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:18 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:18 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:19 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:19 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (315dd2af-3eb5-41d8-ba52-47163bf0afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e54fac3-27cd-4e22-885b-0f4850b8f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e54fac3-27cd-4e22-885b-0f4850b8f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451210883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=960f536b-faad-44ac-a9e2-2d702caf6ed7,host='devstack@QuobyteHD#QuobyteHD',id=14460eb7-fba0-4b36-aaab-97e69fb38742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:20Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ded437c-d8fa-48a4-b415-889783c0c17c),volume_type_id=6ded437c-d8fa-48a4-b415-889783c0c17c)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f65277f-c3e3-46fd-8e18-452b44bf32fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f65277f-c3e3-46fd-8e18-452b44bf32fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf6f060-aefb-4c18-b196-30ed24b1d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf6f060-aefb-4c18-b196-30ed24b1d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14460eb7-fba0-4b36-aaab-97e69fb38742', 'volume_name': 'volume-14460eb7-fba0-4b36-aaab-97e69fb38742', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b06e5-14cf-4bcd-8dae-9c0118074a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b06e5-14cf-4bcd-8dae-9c0118074a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ca392-ef81-4d94-b5e0-e136ca39355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:20 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Volume 14460eb7-fba0-4b36-aaab-97e69fb38742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14460eb7-fba0-4b36-aaab-97e69fb38742', 'volume_size': 1} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=960f536b-faad-44ac-a9e2-2d702caf6ed7,created_at=2026-07-08T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451210883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=960f536b-faad-44ac-a9e2-2d702caf6ed7,host='devstack@QuobyteHD#QuobyteHD',id=14460eb7-fba0-4b36-aaab-97e69fb38742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:20Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ded437c-d8fa-48a4-b415-889783c0c17c),volume_type_id=6ded437c-d8fa-48a4-b415-889783c0c17c)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Creating volume 14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:20 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:20 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 1073741824 Jul 08 16:21:20 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:20 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.507s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:21:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:21:21 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 1073741824" returned: 0 in 1.482s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:21 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:21 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:22 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 0 in 3.384s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_aogaf1npdevstack@QuobyteHD, size 112.00 MB, duration 3.39 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:21:22 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Converted 112.00 MB image at 33.09 MB/s Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:22 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1G Jul 08 16:21:22 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:22 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 0.924s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] <== create_volume: return (2480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ca392-ef81-4d94-b5e0-e136ca39355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14460eb7-fba0-4b36-aaab-97e69fb38742', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3871f4-bd68-47e1-8561-62845d54069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:22 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Volume volume-14460eb7-fba0-4b36-aaab-97e69fb38742 (14460eb7-fba0-4b36-aaab-97e69fb38742): created successfully Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3871f4-bd68-47e1-8561-62845d54069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (315dd2af-3eb5-41d8-ba52-47163bf0afd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9061097e-3ba0-48b1-82f9-9a0faf312f23 tempest-GroupSnapshotsTest-1956020108 None] Created volume successfully. Jul 08 16:21:22 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 1G" returned: 0 in 0.906s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7ff8d-d7f2-49d1-bb28-5030b343e146]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:23 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:23 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:24 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 0 in 1.090s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] GroupSnapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: creating. Jul 08 16:21:24 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:24 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Group snapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: creating. {{(pid=87227) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Creating offline snapshot e5e668b5-c2d3-492d-8696-9389567c7a41 of volume 14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f9cf01-4e6d-4ccc-81fd-d375b70e99c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:24 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:24 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:25 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 1 in 1.010s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Downloaded image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume b7e5d402-2f0b-4405-b4ee-93afa4da6365 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 for user ea3e733de94348228986704ec9b3bcf9 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Marking volume b7e5d402-2f0b-4405-b4ee-93afa4da6365 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Copying metadata from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 to b7e5d402-2f0b-4405-b4ee-93afa4da6365. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Creating volume glance metadata for volume b7e5d402-2f0b-4405-b4ee-93afa4da6365 backed by image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c44b166-c2d6-45d9-a8e1-a9b38015a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5936f44e-6af1-4089-90cc-b2a2e60e6e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Volume volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 (b7e5d402-2f0b-4405-b4ee-93afa4da6365): created successfully Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5936f44e-6af1-4089-90cc-b2a2e60e6e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (f082b733-12d1-4917-b9e3-5938758fe741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9d80efe1-5501-45d1-904b-e23a752006ab tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:21:25 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 0.978s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:25 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 1G Jul 08 16:21:25 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:26 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 1G" returned: 0 in 1.006s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14460eb7-fba0-4b36-aaab-97e69fb38742 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:26 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14460eb7-fba0-4b36-aaab-97e69fb38742 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:26 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (64e3dba5-068c-4f44-b80a-835fe7194ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0d11c-6829-41bf-9b27-8f553a8996ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0d11c-6829-41bf-9b27-8f553a8996ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-922788241',display_name='tempest-VolumesGetTest-Volume-116116228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d8e955-430f-424d-8069-5f4c849696c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:27Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73005dcf-6c41-49d5-bbdd-2306dca6a4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73005dcf-6c41-49d5-bbdd-2306dca6a4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94986e2d-40ac-4c63-9e4a-427b23ac8167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94986e2d-40ac-4c63-9e4a-427b23ac8167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d8e955-430f-424d-8069-5f4c849696c8', 'volume_name': 'volume-48d8e955-430f-424d-8069-5f4c849696c8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24b5a77-f034-41ad-99ea-d04b68e003f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24b5a77-f034-41ad-99ea-d04b68e003f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f779b4da-38fc-4322-8424-f6224702d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:26 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Volume 48d8e955-430f-424d-8069-5f4c849696c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d8e955-430f-424d-8069-5f4c849696c8', 'volume_size': 1} Jul 08 16:21:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:27 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14460eb7-fba0-4b36-aaab-97e69fb38742 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:27 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:21:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:27 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:27 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:27 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.711s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:27 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info Jul 08 16:21:27 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:28 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:28 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:21:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:28 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info Jul 08 16:21:28 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Acquiring lock "cinder-882cc32f-64e2-4547-b9e7-bcfa5793b3d0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "cinder-882cc32f-64e2-4547-b9e7-bcfa5793b3d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Acquiring lock "cinder-quobyte-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "cinder-quobyte-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f45d9-b844-4493-ad45-b2a828cdf3f2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:29 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 Jul 08 16:21:29 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:29 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.info" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.082s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.538s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-922788241',display_name='tempest-VolumesGetTest-Volume-116116228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d8e955-430f-424d-8069-5f4c849696c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fa1772e5c449d98b3bbb8d8b3be5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:27Z,use_quota=True,user_id='ea3e733de94348228986704ec9b3bcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Creating volume 48d8e955-430f-424d-8069-5f4c849696c8 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:29 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:29 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 1073741824 Jul 08 16:21:29 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d1528dc3-3e3a-4d9a-8a5f-94abf7286927 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: created successfully Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Flow 'volume_create_manager' (0ef4c625-ca55-4668-99e5-96e40af93c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d34faa9-b5b9-435f-a8ec-ca58c6d111cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d34faa9-b5b9-435f-a8ec-ca58c6d111cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110721883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82b5cfc-ad18-4e46-9d45-080bfe6da265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fbff6888d4bc7be4493cc5e58f408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:30Z,use_quota=True,user_id='1d5069fdfb3f4abc943d3ff3b5d29f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79c7dbd-cf29-4d23-8b45-bd6f512e10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79c7dbd-cf29-4d23-8b45-bd6f512e10e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906932a5-fd59-47c8-bf72-8f0f51ca2f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906932a5-fd59-47c8-bf72-8f0f51ca2f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82b5cfc-ad18-4e46-9d45-080bfe6da265', 'volume_name': 'volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b7efa6-b16d-4014-bef9-6b0809785248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b7efa6-b16d-4014-bef9-6b0809785248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759b60db-5302-41d2-ab67-920770af29e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:30 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Volume c82b5cfc-ad18-4e46-9d45-080bfe6da265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265', 'volume_size': 1} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:30 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" returned: 0 in 0.848s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:30 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0 Jul 08 16:21:30 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:30 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 1073741824" returned: 0 in 0.971s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:30 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 Jul 08 16:21:30 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:30 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" returned: 0 in 0.715s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "cinder-quobyte-882cc32f-64e2-4547-b9e7-bcfa5793b3d0" released by "delete_volume" :: held 1.620s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Created reservations ['5217d5b2-76f5-4aa3-aed7-1ce27253b339', 'dd4cd4f9-d733-45ae-b99a-deef7e4847ba', 'c018c680-ba39-4e14-b065-584ae8e751c5', '5151866c-cf5c-48ba-8b4d-41a88fbbf30b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:31 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:31 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:31 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8" returned: 0 in 0.743s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110721883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82b5cfc-ad18-4e46-9d45-080bfe6da265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fbff6888d4bc7be4493cc5e58f408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:30Z,use_quota=True,user_id='1d5069fdfb3f4abc943d3ff3b5d29f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Creating volume c82b5cfc-ad18-4e46-9d45-080bfe6da265 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:31 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f779b4da-38fc-4322-8424-f6224702d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d8e955-430f-424d-8069-5f4c849696c8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:31 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 1073741824 Jul 08 16:21:31 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac643fbb-9553-4313-a8c4-a1da1ee2c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Volume volume-48d8e955-430f-424d-8069-5f4c849696c8 (48d8e955-430f-424d-8069-5f4c849696c8): created successfully Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac643fbb-9553-4313-a8c4-a1da1ee2c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Flow 'volume_create_manager' (64e3dba5-068c-4f44-b80a-835fe7194ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fa298811-cbfb-474d-8b98-7527e0d9a3d6 tempest-VolumesGetTest-1198920591 None] Created volume successfully. Jul 08 16:21:31 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Deleted volume successfully. Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31980fb0-4542-4178-9751-3a4b49ef2012 tempest-VolumesNegativeTest-136890357 None] Lock "cinder-882cc32f-64e2-4547-b9e7-bcfa5793b3d0-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-48d8e955-430f-424d-8069-5f4c849696c8-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "cinder-48d8e955-430f-424d-8069-5f4c849696c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-48d8e955-430f-424d-8069-5f4c849696c8" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-48d8e955-430f-424d-8069-5f4c849696c8" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:32 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 1073741824" returned: 0 in 1.131s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c86251-a950-46b4-b958-f49afdd474bb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:32 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 Jul 08 16:21:32 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:32 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 Jul 08 16:21:32 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:33 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.281s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759b60db-5302-41d2-ab67-920770af29e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0d20b5-65a1-4d53-9bff-55c8540ece1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Creating volume 5353aac8-06f6-4ed5-91d7-bce53e6dac8b from snapshot e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Volume volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 (c82b5cfc-ad18-4e46-9d45-080bfe6da265): created successfully Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0d20b5-65a1-4d53-9bff-55c8540ece1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:33 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Flow 'volume_create_manager' (0ef4c625-ca55-4668-99e5-96e40af93c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8" returned: 0 in 0.842s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] snapshot: e5e668b5-c2d3-492d-8696-9389567c7a41, volume: 5353aac8-06f6-4ed5-91d7-bce53e6dac8b, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:21:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c52fb505-8f5f-4a77-aeea-7c83d5892ee8 tempest-ServersNegativeTestJSON-291583750 None] Created volume successfully. Jul 08 16:21:33 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8 Jul 08 16:21:33 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f34254e-3fd2-415c-86cd-574b6ea688ff]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:33 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:33 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:33 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-48d8e955-430f-424d-8069-5f4c849696c8" returned: 0 in 0.739s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-48d8e955-430f-424d-8069-5f4c849696c8" released by "delete_volume" :: held 1.648s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Created reservations ['795fbafc-4db9-471c-9ff0-1fa2a9b609a4', 'a25a9944-23a8-41e2-9ef0-03f165f40fce', '3b7385b5-0597-4a6b-af18-db6fa8b804b2', 'a745f623-eb3a-4fa1-bd42-d6ff5a13a3d3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:34 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:34 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:34 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.901s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14460eb7-fba0-4b36-aaab-97e69fb38742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6a9e3-4e82-4bc9-b202-4efe21ca84db]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:34 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:34 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-b7e5d402-2f0b-4405-b4ee-93afa4da6365-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "cinder-b7e5d402-2f0b-4405-b4ee-93afa4da6365-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Acquiring lock "cinder-quobyte-b7e5d402-2f0b-4405-b4ee-93afa4da6365" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-b7e5d402-2f0b-4405-b4ee-93afa4da6365" acquired by "delete_volume" :: waited 0.042s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c3ca6-1752-4858-b44a-f0582b24e4b6]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:35 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:35 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:35 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.934s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f72cdc80-2973-4e87-92a0-bd73890735c0 tempest-VolumesGetTest-1198920591 None] Lock "cinder-48d8e955-430f-424d-8069-5f4c849696c8-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:35 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 1.388s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:35 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b Jul 08 16:21:35 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:35 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 0 in 0.937s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:35 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:35 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Flow 'volume_create_manager' (026b48e8-e764-487c-a45d-2a9acd9024b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073aaed9-33b9-4a08-a884-b7d684aac9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073aaed9-33b9-4a08-a884-b7d684aac9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1033324327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9594650f-143d-4c0e-8700-3e228426e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fbff6888d4bc7be4493cc5e58f408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:36Z,use_quota=True,user_id='1d5069fdfb3f4abc943d3ff3b5d29f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2871816d-49d9-4456-aab8-11a5cd05c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2871816d-49d9-4456-aab8-11a5cd05c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd6c5de-68d1-49cd-8f73-1371a2ecd35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd6c5de-68d1-49cd-8f73-1371a2ecd35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9594650f-143d-4c0e-8700-3e228426e824', 'volume_name': 'volume-9594650f-143d-4c0e-8700-3e228426e824', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba2fd6b-3c77-488e-9661-fa502a004907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba2fd6b-3c77-488e-9661-fa502a004907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff93e76-99cd-4867-8933-02c7f7545156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:36 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Volume 9594650f-143d-4c0e-8700-3e228426e824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9594650f-143d-4c0e-8700-3e228426e824', 'volume_size': 1} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:36 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 1 in 0.979s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:21:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:36 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365 Jul 08 16:21:36 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:38 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b7e5d402-2f0b-4405-b4ee-93afa4da6365" returned: 0 in 1.620s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "cinder-quobyte-b7e5d402-2f0b-4405-b4ee-93afa4da6365" released by "delete_volume" :: held 3.657s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Created reservations ['90d67e70-4e63-4e85-833e-ba3a3f3174a0', '2dd58f9d-084e-4fc3-8f01-1b465a3865f3', '861f03a2-5f44-4af3-b018-8c6e76b18af7', '1ac5ede8-fded-4a56-9b19-025e259c3dbc'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:38 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:38 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:40 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 2.144s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:40 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Deleted volume successfully. Jul 08 16:21:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7f96fe08-fbb7-43b7-9fa2-36c4016f0d14 tempest-VolumesGetTest-1198920591 None] Lock "cinder-b7e5d402-2f0b-4405-b4ee-93afa4da6365-delete_volume" released by "delete_volume" :: held 6.380s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:42 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" returned: 0 in 6.897s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:42 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[43656c0e-1a79-4825-a059-d954b471dc36]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:42 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:42 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:43 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 1.112s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:43 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:21:43 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Converted 1024.00 MB image at 148.45 MB/s Jul 08 16:21:43 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:21:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:43 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b Jul 08 16:21:43 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:44 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" returned: 0 in 0.886s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" released by "_copy_volume_from_snapshot" :: held 11.321s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" released by "_create_volume_from_snapshot" :: held 11.397s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.434s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.158s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1033324327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9594650f-143d-4c0e-8700-3e228426e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fbff6888d4bc7be4493cc5e58f408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:36Z,use_quota=True,user_id='1d5069fdfb3f4abc943d3ff3b5d29f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Creating volume 9594650f-143d-4c0e-8700-3e228426e824 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:44 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:44 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 1073741824 Jul 08 16:21:44 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-84839369-d0b6-4908-83cd-61cabd015d29 tempest-GroupSnapshotsTest-1956020108 None] Create group from source-snapshot-a3233519-d22e-4b42-8ce4-49c299d5a2ee completed successfully. Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (fe3327f9-aa0a-4117-bdff-127497b27f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cee328-6955-42d8-9e46-aa9ab8c05ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cee328-6955-42d8-9e46-aa9ab8c05ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1614493325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cd3fa8-3613-4aba-ba80-46bb351ddff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:46Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0c940d-2c76-4d41-ab1f-2c124473afc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0c940d-2c76-4d41-ab1f-2c124473afc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec613bbb-a940-4060-a499-4ecacd9e2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec613bbb-a940-4060-a499-4ecacd9e2874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8cd3fa8-3613-4aba-ba80-46bb351ddff3', 'volume_name': 'volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a0463-f632-4072-8021-c13a9ea040b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a0463-f632-4072-8021-c13a9ea040b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb309d2-66bb-4acc-9593-6533c2540fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Volume f8cd3fa8-3613-4aba-ba80-46bb351ddff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3', 'volume_size': 1} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9250614-ac7b-4ae4-b9ce-a68416827d13]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:45 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b Jul 08 16:21:45 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:46 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 1073741824" returned: 0 in 1.466s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:46 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 Jul 08 16:21:46 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:46 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" returned: 0 in 0.842s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:46 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b Jul 08 16:21:46 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:46 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824" returned: 0 in 0.711s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1614493325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cd3fa8-3613-4aba-ba80-46bb351ddff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:46Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Creating volume f8cd3fa8-3613-4aba-ba80-46bb351ddff3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:46 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff93e76-99cd-4867-8933-02c7f7545156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9594650f-143d-4c0e-8700-3e228426e824', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15efc7c8-e1df-4b61-9676-3f37b9a80e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:46 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 1073741824 Jul 08 16:21:46 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Volume volume-9594650f-143d-4c0e-8700-3e228426e824 (9594650f-143d-4c0e-8700-3e228426e824): created successfully Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15efc7c8-e1df-4b61-9676-3f37b9a80e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Flow 'volume_create_manager' (026b48e8-e764-487c-a45d-2a9acd9024b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d4f1bd47-1615-44b8-8393-2ebcd21a047a tempest-ServersNegativeTestJSON-291583750 None] Created volume successfully. Jul 08 16:21:47 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" returned: 0 in 0.724s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-5353aac8-06f6-4ed5-91d7-bce53e6dac8b" released by "delete_volume" :: held 1.650s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['4781755b-1275-4859-bfff-26049edbe822'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:47 devstack cinder-volume[87227]: WARNING cinder.quota [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1975106479 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1975106479, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:21:47 devstack cinder-volume[87227]: WARNING cinder.quota [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1975106479 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1975106479, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['80f21f2a-77b1-4ac6-a70a-2467d8c94171', '0c756656-4f70-4b84-b3a9-954d88523901', '58eac5c8-f6e4-4265-92a7-3bace89b838b', '2d8a0741-a4da-4b71-952f-56b5f610a9f3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:47 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:47 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:48 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 1073741824" returned: 0 in 1.250s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:48 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 Jul 08 16:21:48 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: deleting Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: deleting {{(pid=87227) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Deleting offline snapshot e5e668b5-c2d3-492d-8696-9389567c7a41 of volume 14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] snapshot_file for this snap is: volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b235cf-7a07-4d53-9caf-ab8c163e0559]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:48 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-78b12aac-8a26-46a6-abef-cb49aaf3a7ee tempest-GroupSnapshotsTest-1956020108 None] Delete group completed successfully. Jul 08 16:21:48 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:48 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (3c3cabdd-42df-4f5f-a4ff-079e14a16ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ee25f3-3317-4c92-8a04-e20b4caec29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ee25f3-3317-4c92-8a04-e20b4caec29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2140957094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f552eee-e226-4851-b864-0077f06b69f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:49Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9740e12-2897-4e59-adb0-bb488cb06055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9740e12-2897-4e59-adb0-bb488cb06055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3b9e7-c523-458f-9157-29e620ebedb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3b9e7-c523-458f-9157-29e620ebedb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f552eee-e226-4851-b864-0077f06b69f6', 'volume_name': 'volume-3f552eee-e226-4851-b864-0077f06b69f6', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c4feb6-1789-49f9-ac2e-0b4a3bd19663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c4feb6-1789-49f9-ac2e-0b4a3bd19663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ecc74b-e93a-45c5-b72b-ee37833bf0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Volume 3f552eee-e226-4851-b864-0077f06b69f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f552eee-e226-4851-b864-0077f06b69f6', 'volume_size': 1} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:49 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" returned: 0 in 0.929s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2140957094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f552eee-e226-4851-b864-0077f06b69f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:49Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Creating volume 3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:49 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb309d2-66bb-4acc-9593-6533c2540fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 1073741824 Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0babd5-b33a-4f27-b9e8-8e3470327d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:49 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "cinder-9594650f-143d-4c0e-8700-3e228426e824-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Volume volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 (f8cd3fa8-3613-4aba-ba80-46bb351ddff3): created successfully Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0babd5-b33a-4f27-b9e8-8e3470327d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (fe3327f9-aa0a-4117-bdff-127497b27f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-9594650f-143d-4c0e-8700-3e228426e824-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a70951e1-83c7-44aa-a6c1-02f41ab1f55c tempest-VolumesListTestJSON-999870030 None] Created volume successfully. Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "cinder-quobyte-9594650f-143d-4c0e-8700-3e228426e824" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-quobyte-9594650f-143d-4c0e-8700-3e228426e824" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c27db4-a725-4f1f-97ba-9c983aea9bf2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:49 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 Jul 08 16:21:49 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:49 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14460eb7-fba0-4b36-aaab-97e69fb38742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06fa7a-0329-4bbb-ac2e-e281979c6e34]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:49 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:49 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:50 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824" returned: 0 in 0.817s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:50 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 1073741824" returned: 0 in 1.002s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:50 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824 Jul 08 16:21:50 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:50 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 Jul 08 16:21:50 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:50 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:50 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:50 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (cecf1828-36c6-401f-87f8-3fb71822dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cb73e3-5039-4d60-ae0f-1b24db9aa73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cb73e3-5039-4d60-ae0f-1b24db9aa73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1812462426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb5e33-d9ec-4d39-80e2-51529f187868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:50Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bdcc13-c543-4600-84a3-5ff4e5301769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bdcc13-c543-4600-84a3-5ff4e5301769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c188b287-2b6b-4c4a-a09a-fe1e42f1b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c188b287-2b6b-4c4a-a09a-fe1e42f1b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84eb5e33-d9ec-4d39-80e2-51529f187868', 'volume_name': 'volume-84eb5e33-d9ec-4d39-80e2-51529f187868', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ee3fb0-1a1d-45e1-be0d-23a668711e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ee3fb0-1a1d-45e1-be0d-23a668711e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411d8495-82b3-4a09-9f5a-dc5d698c916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Volume 84eb5e33-d9ec-4d39-80e2-51529f187868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84eb5e33-d9ec-4d39-80e2-51529f187868', 'volume_size': 1} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:50 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9594650f-143d-4c0e-8700-3e228426e824" returned: 0 in 0.829s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:50 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-quobyte-9594650f-143d-4c0e-8700-3e228426e824" released by "delete_volume" :: held 1.688s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6" returned: 0 in 0.792s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1812462426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb5e33-d9ec-4d39-80e2-51529f187868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:50Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Creating volume 84eb5e33-d9ec-4d39-80e2-51529f187868 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:50 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:50 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 1073741824 Jul 08 16:21:50 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ecc74b-e93a-45c5-b72b-ee37833bf0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f552eee-e226-4851-b864-0077f06b69f6', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071c121-ae39-4106-b5e5-dc6952bdfd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Volume volume-3f552eee-e226-4851-b864-0077f06b69f6 (3f552eee-e226-4851-b864-0077f06b69f6): created successfully Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071c121-ae39-4106-b5e5-dc6952bdfd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (3c3cabdd-42df-4f5f-a4ff-079e14a16ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Created reservations ['c85fe029-a7cc-425e-9bc9-c7b91eb02e91', 'ab8af542-a518-40a7-91fd-d56e7c6e9827', '23fe35af-8a8e-4b17-b495-da16f1136f19', '6d6b4381-8ffd-4d9d-956e-15a7e97f688f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-71deb0a3-266e-4159-bb55-1cde1af89fcc tempest-VolumesSnapshotTestJSON-681252021 None] Created volume successfully. Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:51 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:51 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:51 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.776s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:51 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41 Jul 08 16:21:51 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "cinder-c82b5cfc-ad18-4e46-9d45-080bfe6da265-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-c82b5cfc-ad18-4e46-9d45-080bfe6da265-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "cinder-quobyte-c82b5cfc-ad18-4e46-9d45-080bfe6da265" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-quobyte-c82b5cfc-ad18-4e46-9d45-080bfe6da265" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e8be4-c4ec-4a31-b346-41c357861f8a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:51 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 Jul 08 16:21:51 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:51 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.743s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Deleted volume successfully. Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-71a00322-5ca6-486e-9a67-b70452bfb323 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-9594650f-143d-4c0e-8700-3e228426e824-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:51 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 1073741824" returned: 0 in 1.014s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:52 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 Jul 08 16:21:52 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:52 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742.e5e668b5-c2d3-492d-8696-9389567c7a41" returned: 0 in 0.811s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-e5e668b5-c2d3-492d-8696-9389567c7a41" released by "_delete_snapshot" :: held 3.593s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" released by "delete_snapshot" :: held 3.626s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:52 devstack cinder-volume[87227]: WARNING cinder.quota [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1975106479 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1975106479, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['cd6d79ca-c995-4e69-b6e9-adf55e1ecb35', 'cf5dcc86-c0cc-4219-8788-262938794a99', '6bfb9413-4b1b-4b70-99d8-b1a05cf52ebc', '95be2885-7939-4b4a-b616-d7f4751b3189'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e84cc713-7811-4afb-9716-37b9120f58f5 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot a3233519-d22e-4b42-8ce4-49c299d5a2ee: deleted successfully Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:52 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265" returned: 0 in 0.915s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:52 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265 Jul 08 16:21:52 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:52 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868" returned: 0 in 0.724s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.255s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411d8495-82b3-4a09-9f5a-dc5d698c916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84eb5e33-d9ec-4d39-80e2-51529f187868', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac8875c-6186-49ee-b413-e14663e2c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Creating offline snapshot 04f607fc-0ee4-4f73-97eb-b3508a53ae77 of volume 3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:21:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Volume volume-84eb5e33-d9ec-4d39-80e2-51529f187868 (84eb5e33-d9ec-4d39-80e2-51529f187868): created successfully Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac8875c-6186-49ee-b413-e14663e2c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (cecf1828-36c6-401f-87f8-3fb71822dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1147be3-bdbe-4c9d-b094-f1fa4766b434]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f28917d0-7141-48fb-8e52-6541cf7595bb tempest-VolumesListTestJSON-999870030 None] Created volume successfully. Jul 08 16:21:52 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 Jul 08 16:21:52 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1fdf04-c052-4436-8279-4fcca5a95d8a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:53 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c82b5cfc-ad18-4e46-9d45-080bfe6da265" returned: 0 in 0.749s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-quobyte-c82b5cfc-ad18-4e46-9d45-080bfe6da265" released by "delete_volume" :: held 1.718s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:53 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:53 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Created reservations ['dbeaaa40-c9b1-43c3-97d1-ae6cb1c3f30a', 'c1691ad8-4dc8-476f-a3d0-001e210bd4a4', 'd6849d1c-b432-46b5-be07-79fd208943ea', '5f99cf62-544d-4026-849b-fef3ab0bd474'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:53 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:53 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:53 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:53 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 1G Jul 08 16:21:53 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:54 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 0.986s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:54 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742 Jul 08 16:21:54 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:54 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.872s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Deleted volume successfully. Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d8a3fa29-7abb-43bc-a25a-413e9314f331 tempest-ServersNegativeTestJSON-291583750 None] Lock "cinder-c82b5cfc-ad18-4e46-9d45-080bfe6da265-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (afa716c4-4c91-43e7-b721-111dfbe81c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac28e86-86e6-4984-8417-71d7c4179a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac28e86-86e6-4984-8417-71d7c4179a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1688410670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bc79cc-ba23-4715-b034-be67c4c21419,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:55Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ba7387-7270-444f-9062-a01385df8152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ba7387-7270-444f-9062-a01385df8152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d6984d-0bc7-4821-a725-a45a2a628b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d6984d-0bc7-4821-a725-a45a2a628b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bc79cc-ba23-4715-b034-be67c4c21419', 'volume_name': 'volume-42bc79cc-ba23-4715-b034-be67c4c21419', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0a2e9f-1433-434e-8147-14b6fcc73471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0a2e9f-1433-434e-8147-14b6fcc73471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee64f4b-cdb9-42b3-a4ca-f0e08949e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Volume 42bc79cc-ba23-4715-b034-be67c4c21419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bc79cc-ba23-4715-b034-be67c4c21419', 'volume_size': 1} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:54 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 1G" returned: 0 in 1.073s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f552eee-e226-4851-b864-0077f06b69f6 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:54 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f552eee-e226-4851-b864-0077f06b69f6 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 Jul 08 16:21:54 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:55 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-14460eb7-fba0-4b36-aaab-97e69fb38742" returned: 0 in 0.845s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-14460eb7-fba0-4b36-aaab-97e69fb38742" released by "delete_volume" :: held 1.899s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['6c7176ed-063f-4e0c-85f6-4c06f88ac634'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:55 devstack cinder-volume[87227]: WARNING cinder.db.api [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1975106479'] Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['9d4f710b-4f08-47a4-9389-b935f5ccf035', 'f76339b1-17c0-4e2a-b696-ae00bd501101', 'baba0249-0df2-44a7-b56b-28e69614042e', '6b6b7513-a5da-4455-a292-a6a30347c0f8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:55 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:21:55 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:55 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f552eee-e226-4851-b864-0077f06b69f6 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:55 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 is being set with open permissions: ugo+rw Jul 08 16:21:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:55 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 Jul 08 16:21:55 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eb9f7393-8532-4f99-8b25-e52813068e70 tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-328901448: creating Jul 08 16:21:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eb9f7393-8532-4f99-8b25-e52813068e70 tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-328901448: created successfully Jul 08 16:21:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eb9f7393-8532-4f99-8b25-e52813068e70 tempest-GroupSnapshotsTest-1956020108 None] Create group completed successfully. Jul 08 16:21:56 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:56 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:21:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-45b60553-797e-4691-8ebc-6902b7002963 tempest-GroupSnapshotsTest-1956020108 None] Delete group completed successfully. Jul 08 16:21:56 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:56 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info Jul 08 16:21:56 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:57 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:57 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info is being set with open permissions: ugo+rw Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:57 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info Jul 08 16:21:57 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (b63ffc3b-638f-4c5d-bfd2-c8fa93faf7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2304838-f1e9-4202-9d09-97c3ca80008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2304838-f1e9-4202-9d09-97c3ca80008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7388313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,host='devstack@QuobyteHD#QuobyteHD',id=f2f168b3-18a9-4c8a-93c8-4e947cb8ffea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:58Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175bdd74-8e36-4d1a-a62a-184b44792628),volume_type_id=175bdd74-8e36-4d1a-a62a-184b44792628)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab20c8a-e599-4f03-b97b-e0d5364a99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab20c8a-e599-4f03-b97b-e0d5364a99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99e9280-d129-4fff-87a8-41a8e6ba505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99e9280-d129-4fff-87a8-41a8e6ba505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f168b3-18a9-4c8a-93c8-4e947cb8ffea', 'volume_name': 'volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6ea1f2-1bc8-448c-aa5f-5bade8982ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6ea1f2-1bc8-448c-aa5f-5bade8982ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b41128-5cc5-4bd0-ba70-a31bf2740405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:57 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Volume f2f168b3-18a9-4c8a-93c8-4e947cb8ffea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea', 'volume_size': 1} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:57 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.info" returned: 0 in 0.735s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.215s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1688410670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bc79cc-ba23-4715-b034-be67c4c21419,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261908fe788e43afa16315f03d2a13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:55Z,use_quota=True,user_id='42667acd91f840dab9135db7cedcc041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Creating volume 42bc79cc-ba23-4715-b034-be67c4c21419 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:57 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:57 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 1073741824 Jul 08 16:21:57 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-580a7566-5b37-40ed-a878-cb4db4c3d755 tempest-VolumesSnapshotTestJSON-681252021 None] Create snapshot completed successfully Jul 08 16:21:58 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 1073741824" returned: 0 in 0.860s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:58 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 Jul 08 16:21:58 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-04f607fc-0ee4-4f73-97eb-b3508a53ae77-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-04f607fc-0ee4-4f73-97eb-b3508a53ae77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-04f607fc-0ee4-4f73-97eb-b3508a53ae77" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-04f607fc-0ee4-4f73-97eb-b3508a53ae77" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Deleting offline snapshot 04f607fc-0ee4-4f73-97eb-b3508a53ae77 of volume 3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] snapshot_file for this snap is: volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ded18-71ed-4e4e-a0eb-412eaf57e687]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:59 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 Jul 08 16:21:59 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:59 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,created_at=2026-07-08T14:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7388313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,host='devstack@QuobyteHD#QuobyteHD',id=f2f168b3-18a9-4c8a-93c8-4e947cb8ffea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:21:58Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175bdd74-8e36-4d1a-a62a-184b44792628),volume_type_id=175bdd74-8e36-4d1a-a62a-184b44792628)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Creating volume f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:21:59 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:21:59 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea 1073741824 Jul 08 16:21:59 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee64f4b-cdb9-42b3-a4ca-f0e08949e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bc79cc-ba23-4715-b034-be67c4c21419', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971a51de-89ba-442f-9307-094dbc2b2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:21:59 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Volume volume-42bc79cc-ba23-4715-b034-be67c4c21419 (42bc79cc-ba23-4715-b034-be67c4c21419): created successfully Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971a51de-89ba-442f-9307-094dbc2b2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Flow 'volume_create_manager' (afa716c4-4c91-43e7-b721-111dfbe81c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:21:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-92cb2b9e-2b71-4390-98e7-607edab9b74d tempest-VolumesListTestJSON-999870030 None] Created volume successfully. Jul 08 16:21:59 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77" returned: 0 in 0.828s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f552eee-e226-4851-b864-0077f06b69f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b489cdd-9aee-47d0-a3f8-66180b37813b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:21:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:00 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 Jul 08 16:22:00 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:00 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea 1073741824" returned: 0 in 1.019s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:00 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea Jul 08 16:22:00 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:00 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6" returned: 0 in 0.944s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:00 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 Jul 08 16:22:00 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:01 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b41128-5cc5-4bd0-ba70-a31bf2740405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b082c4a7-5352-418e-ad26-c44e6d978e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Volume volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea (f2f168b3-18a9-4c8a-93c8-4e947cb8ffea): created successfully Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b082c4a7-5352-418e-ad26-c44e6d978e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (b63ffc3b-638f-4c5d-bfd2-c8fa93faf7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a2f153d6-4e38-413b-aa29-17ee238ba437 tempest-GroupSnapshotsTest-1956020108 None] Created volume successfully. Jul 08 16:22:01 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77" returned: 0 in 1.066s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:01 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77 Jul 08 16:22:01 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-42bc79cc-ba23-4715-b034-be67c4c21419-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-42bc79cc-ba23-4715-b034-be67c4c21419-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-quobyte-42bc79cc-ba23-4715-b034-be67c4c21419" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-42bc79cc-ba23-4715-b034-be67c4c21419" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf8e41-84c5-4844-8688-d4aaffbed375]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:02 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 Jul 08 16:22:02 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:02 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6.04f607fc-0ee4-4f73-97eb-b3508a53ae77" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-04f607fc-0ee4-4f73-97eb-b3508a53ae77" released by "_delete_snapshot" :: held 3.769s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" released by "delete_snapshot" :: held 3.800s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['1fec3771-9f61-4c4c-8c23-8d8b6dcdfeb1', '1de8a53e-353c-48f4-a45c-d00688a40961', 'f1bd0e9f-f6f2-421c-bccb-8b4fddb19977', 'c1a109cb-2007-4457-9bd5-b274c6a02780'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Delete snapshot completed successfully. Jul 08 16:22:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9083d7fb-a984-4bc7-9a4d-e54a3cf9cb62 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-04f607fc-0ee4-4f73-97eb-b3508a53ae77-delete_snapshot" released by "delete_snapshot" :: held 4.043s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:03 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:03 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419 Jul 08 16:22:03 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (3f6f30f2-0eb0-409c-a9d2-1cfdd86539e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da54bdd3-8620-46d3-a2f0-0b70bb736b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da54bdd3-8620-46d3-a2f0-0b70bb736b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313845014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,host='devstack@QuobyteHD#QuobyteHD',id=08fe24c1-706a-4261-931e-addcba5f1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:03Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175bdd74-8e36-4d1a-a62a-184b44792628),volume_type_id=175bdd74-8e36-4d1a-a62a-184b44792628)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ce4c8-7ed3-4396-a81e-66f44eee9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ce4c8-7ed3-4396-a81e-66f44eee9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b569b3d-9557-4af9-9dc1-61c1bc88631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b569b3d-9557-4af9-9dc1-61c1bc88631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fe24c1-706a-4261-931e-addcba5f1265', 'volume_name': 'volume-08fe24c1-706a-4261-931e-addcba5f1265', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7163ff4b-60da-45c5-b122-486ea094d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7163ff4b-60da-45c5-b122-486ea094d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57932c8c-6861-4674-b5f9-0372f3030d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Volume 08fe24c1-706a-4261-931e-addcba5f1265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fe24c1-706a-4261-931e-addcba5f1265', 'volume_size': 1} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,created_at=2026-07-08T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313845014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6a04e62-4a0c-4506-bef8-1559c1a0df90,host='devstack@QuobyteHD#QuobyteHD',id=08fe24c1-706a-4261-931e-addcba5f1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:03Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175bdd74-8e36-4d1a-a62a-184b44792628),volume_type_id=175bdd74-8e36-4d1a-a62a-184b44792628)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Creating volume 08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:03 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:22:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:03 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 1073741824 Jul 08 16:22:03 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (54d9828b-6dbc-413d-8e67-e1e07c9049e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc3cc98-1d01-4d42-846f-3cf685b01e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc3cc98-1d01-4d42-846f-3cf685b01e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131673513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324fd010-4986-4ee5-924b-386b18ce19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:04Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6a07c-c1be-4091-861e-16018e14e432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6a07c-c1be-4091-861e-16018e14e432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfff921-8087-4b25-9433-2bb42a89c084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfff921-8087-4b25-9433-2bb42a89c084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324fd010-4986-4ee5-924b-386b18ce19aa', 'volume_name': 'volume-324fd010-4986-4ee5-924b-386b18ce19aa', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c08dd9-028d-44e3-b297-0c3dac08ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c08dd9-028d-44e3-b297-0c3dac08ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9289f4b0-8651-421f-af95-10bc112b8aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:04 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Volume 324fd010-4986-4ee5-924b-386b18ce19aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324fd010-4986-4ee5-924b-386b18ce19aa', 'volume_size': 1} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:04 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-42bc79cc-ba23-4715-b034-be67c4c21419" returned: 0 in 0.985s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-42bc79cc-ba23-4715-b034-be67c4c21419" released by "delete_volume" :: held 1.956s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Created reservations ['aa7e6767-b156-449f-90ee-3ac147f21cc4', 'd77a5dec-b738-49da-b1a2-442a2a0c8e25', 'e90e48e0-66f6-42ac-b82b-f1604e7684aa', 'decb9bd6-38c0-41d5-a93b-66fe2e4ce912'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:04 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:04 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-84eb5e33-d9ec-4d39-80e2-51529f187868-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-84eb5e33-d9ec-4d39-80e2-51529f187868-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:04 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-quobyte-84eb5e33-d9ec-4d39-80e2-51529f187868" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 1073741824" returned: 0 in 1.218s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-84eb5e33-d9ec-4d39-80e2-51529f187868" acquired by "delete_volume" :: waited 0.042s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c10db-a5bf-4fcc-8165-d26ec110c489]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:04 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 Jul 08 16:22:04 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:04 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 Jul 08 16:22:04 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:05 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.950s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Deleted volume successfully. Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60804488-917e-4831-8c2e-6761d1bc4516 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-42bc79cc-ba23-4715-b034-be67c4c21419-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:05 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131673513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324fd010-4986-4ee5-924b-386b18ce19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:04Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Creating volume 324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:05 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:05 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa 1073741824 Jul 08 16:22:05 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57932c8c-6861-4674-b5f9-0372f3030d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fe24c1-706a-4261-931e-addcba5f1265', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d06aa57-f1e5-4bac-ad41-21f1757dc46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:05 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Volume volume-08fe24c1-706a-4261-931e-addcba5f1265 (08fe24c1-706a-4261-931e-addcba5f1265): created successfully Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d06aa57-f1e5-4bac-ad41-21f1757dc46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (3f6f30f2-0eb0-409c-a9d2-1cfdd86539e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:05 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868 Jul 08 16:22:05 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-95d476f6-5c63-479b-8b28-6410aa5ff65e tempest-GroupSnapshotsTest-1956020108 None] Created volume successfully. Jul 08 16:22:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9be10efe-3eb7-43b4-a792-327b286a027c tempest-GroupSnapshotsTest-1956020108 None] Update group completed successfully. Jul 08 16:22:06 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-84eb5e33-d9ec-4d39-80e2-51529f187868" returned: 0 in 0.814s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-84eb5e33-d9ec-4d39-80e2-51529f187868" released by "delete_volume" :: held 1.814s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Created reservations ['0537b978-5f2d-4436-af4c-db7d5263812b', '245c334d-897b-493b-ad99-a445b2ac5db2', 'c726d172-709e-45d9-a299-f31cfcb81913', '14e17acf-9e16-4bf9-8525-c78266bc9587'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:06 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa 1073741824" returned: 0 in 1.063s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:06 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:06 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:06 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:06 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-f8cd3fa8-3613-4aba-ba80-46bb351ddff3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-f8cd3fa8-3613-4aba-ba80-46bb351ddff3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "cinder-quobyte-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[599917a6-b754-4241-81e3-43e69727afd5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:07 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 Jul 08 16:22:07 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1113cec9-5b31-49e1-bb7d-1fc5f0dce316 tempest-GroupSnapshotsTest-1956020108 None] Update group completed successfully. Jul 08 16:22:07 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.950s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Deleted volume successfully. Jul 08 16:22:07 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-06e67840-c13d-4209-96ef-7776237dcd83 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-84eb5e33-d9ec-4d39-80e2-51529f187868-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 0.915s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9289f4b0-8651-421f-af95-10bc112b8aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324fd010-4986-4ee5-924b-386b18ce19aa', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4760874-d5fb-47b7-9dc2-9d653e294932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:07 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Volume volume-324fd010-4986-4ee5-924b-386b18ce19aa (324fd010-4986-4ee5-924b-386b18ce19aa): created successfully Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4760874-d5fb-47b7-9dc2-9d653e294932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (54d9828b-6dbc-413d-8e67-e1e07c9049e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4b44aa2f-f9b9-40f0-a030-0d16dfdbd31b tempest-VolumesSnapshotTestJSON-681252021 None] Created volume successfully. Jul 08 16:22:08 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" returned: 0 in 0.991s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:08 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3 Jul 08 16:22:08 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Creating offline snapshot f553b532-2db6-4c8b-bc4f-8f78a1d7c821 of volume 324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5014d4-5d6a-4a21-a710-e28b5f59d482]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eb35c242-83c5-4b04-b669-07f9653d0320 tempest-GroupSnapshotsTest-1956020108 None] Update group completed successfully. Jul 08 16:22:08 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:08 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:08 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" returned: 0 in 0.794s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-quobyte-f8cd3fa8-3613-4aba-ba80-46bb351ddff3" released by "delete_volume" :: held 1.830s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:08 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Created reservations ['3fabddd3-0339-4183-9a85-58aa992a3739', 'a9911d73-6746-49c6-b642-93b717c0d337', 'b90e4ccd-7bdd-4d3f-815c-6219a885335b', '4425c694-e8e9-4e01-a3e7-75343357bfec'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:09 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:09 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:09 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 0.856s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:09 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 1G Jul 08 16:22:09 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:09 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:09 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Deleted volume successfully. Jul 08 16:22:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d245381-3726-4f3b-ab08-290e2021edb2 tempest-VolumesListTestJSON-999870030 None] Lock "cinder-f8cd3fa8-3613-4aba-ba80-46bb351ddff3-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9f45e1ed-ca6c-4f76-90ac-352ddd375d0d tempest-GroupSnapshotsTest-1956020108 None] Update group completed successfully. Jul 08 16:22:10 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 1G" returned: 0 in 1.264s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324fd010-4986-4ee5-924b-386b18ce19aa -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:10 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324fd010-4986-4ee5-924b-386b18ce19aa -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:10 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] GroupSnapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: creating. Jul 08 16:22:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Group snapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: creating. {{(pid=87227) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 16:22:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:11 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324fd010-4986-4ee5-924b-386b18ce19aa -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 0.954s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:11 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 is being set with open permissions: ugo+rw Jul 08 16:22:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:11 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:11 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:12 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:12 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info Jul 08 16:22:12 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Flow 'volume_create_manager' (6314c1d3-7739-4d62-ba95-4dcebf319ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15edad1c-2538-4d75-8a3a-1bac341465a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15edad1c-2538-4d75-8a3a-1bac341465a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1290169982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4952ee-483d-4d64-ab45-b41713a96965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b72b1be12b425db3647bcd8ae2253f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:13Z,use_quota=True,user_id='ce2bd3053f2741a5ba5aa3ccc43cb92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bdb8ef-52f2-4997-a7ef-abde08c6387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bdb8ef-52f2-4997-a7ef-abde08c6387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8474c61e-b365-4778-bbec-b42c14cf84ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8474c61e-b365-4778-bbec-b42c14cf84ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4952ee-483d-4d64-ab45-b41713a96965', 'volume_name': 'volume-1f4952ee-483d-4d64-ab45-b41713a96965', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8039b7bb-9520-468b-83b9-7675debdc481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8039b7bb-9520-468b-83b9-7675debdc481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d6eac2-d025-4b22-a053-cd38e46b7fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:12 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Volume 1f4952ee-483d-4d64-ab45-b41713a96965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4952ee-483d-4d64-ab45-b41713a96965', 'volume_size': 1} Jul 08 16:22:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:13 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info" returned: 0 in 0.746s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:13 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info is being set with open permissions: ugo+rw Jul 08 16:22:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:13 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info Jul 08 16:22:13 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:14 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.info" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.350s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.269s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Creating offline snapshot 1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b of volume f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ba279-c09e-4efc-92e4-12cd7e16379d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-52bfa4ee-fd2f-48ff-b092-79d5f72e7639 tempest-VolumesSnapshotTestJSON-681252021 None] Create snapshot completed successfully Jul 08 16:22:14 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea Jul 08 16:22:14 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:14 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" returned: 0 in 0.802s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:14 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b 1G Jul 08 16:22:14 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (f35dec97-ff79-4f4a-9638-ab5861e06856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddb89f8-4c5e-42d9-8bbc-6a95c65d6d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddb89f8-4c5e-42d9-8bbc-6a95c65d6d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-350616242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d223d69-cd92-4a36-abf3-56e49775eba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f553b532-2db6-4c8b-bc4f-8f78a1d7c821,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:16Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ce7cc-6aa7-4525-a900-28835dcdd6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ce7cc-6aa7-4525-a900-28835dcdd6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7259a3ec-94e6-4664-a990-b14e4e8c7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7259a3ec-94e6-4664-a990-b14e4e8c7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d223d69-cd92-4a36-abf3-56e49775eba9', 'volume_name': 'volume-8d223d69-cd92-4a36-abf3-56e49775eba9', 'volume_size': 2, 'snapshot_id': 'f553b532-2db6-4c8b-bc4f-8f78a1d7c821'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3f5db1-667e-47f2-b6c5-ca77fd26bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3f5db1-667e-47f2-b6c5-ca77fd26bae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c76ed63-16bf-4ac0-89d2-1a6a151ec8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Volume 8d223d69-cd92-4a36-abf3-56e49775eba9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d223d69-cd92-4a36-abf3-56e49775eba9', 'volume_size': 2, 'snapshot_id': 'f553b532-2db6-4c8b-bc4f-8f78a1d7c821'} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:15 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b 1G" returned: 0 in 1.006s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:15 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b Jul 08 16:22:15 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:16 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" returned: 0 in 0.740s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:16 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:16 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b Jul 08 16:22:16 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:17 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" returned: 0 in 0.656s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:17 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info Jul 08 16:22:17 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:18 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info" returned: 0 in 0.716s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:18 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:18 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info Jul 08 16:22:18 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:18 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.info" returned: 0 in 0.676s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=152,cinder:SELECT=142,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Creating offline snapshot 715ddf12-17cb-4bef-8b00-b073db480321 of volume 08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e900ec7-faba-4d75-b6f2-1631d1bd8590]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:18 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 Jul 08 16:22:18 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:19 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:19 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:19 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:19 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 1G Jul 08 16:22:19 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:20 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.749s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:22:20 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 1G" returned: 0 in 0.913s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe24c1-706a-4261-931e-addcba5f1265 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:20 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe24c1-706a-4261-931e-addcba5f1265 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 Jul 08 16:22:20 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:21 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe24c1-706a-4261-931e-addcba5f1265 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321" returned: 0 in 0.786s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:21 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:21 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 Jul 08 16:22:21 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:22 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321" returned: 0 in 0.708s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:22 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=133,cinder:INSERT=45,cinder:UPDATE=142,cinder:DELETE=11 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:22:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:22 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info Jul 08 16:22:22 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:22 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:22 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:22 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info Jul 08 16:22:22 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:23 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.info" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.782s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.707s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-8d223d69-cd92-4a36-abf3-56e49775eba9" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-8d223d69-cd92-4a36-abf3-56e49775eba9" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Creating volume 8d223d69-cd92-4a36-abf3-56e49775eba9 from snapshot f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] snapshot: f553b532-2db6-4c8b-bc4f-8f78a1d7c821, volume: 8d223d69-cd92-4a36-abf3-56e49775eba9, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdb453-f762-4144-a0c0-7d0df9cf97cd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-004ce24e-21aa-4d88-a802-91e4d4a37741 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: created successfully Jul 08 16:22:23 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:23 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:24 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: deleting Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 0.841s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-324fd010-4986-4ee5-924b-386b18ce19aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e5b55-b26a-40fb-b624-938967274e49]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: deleting {{(pid=87227) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Deleting offline snapshot 1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b of volume f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:24 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:24 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] snapshot_file for this snap is: volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f32dc9-823a-4e9a-b5bf-fae075f879b2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:24 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b Jul 08 16:22:24 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:25 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 0.868s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:25 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 Jul 08 16:22:25 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:25 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133e648-ff65-4eef-9079-cba57aabca0a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:25 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea Jul 08 16:22:25 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:26 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" returned: 0 in 1.194s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:26 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b Jul 08 16:22:26 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:28 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" returned: 0 in 2.203s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:29 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b Jul 08 16:22:29 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:31 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea.1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" returned: 0 in 2.264s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-1cc4bab9-f0b5-47f1-a9b8-947e91b38a8b" released by "_delete_snapshot" :: held 6.716s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" released by "delete_snapshot" :: held 6.768s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-715ddf12-17cb-4bef-8b00-b073db480321" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-715ddf12-17cb-4bef-8b00-b073db480321" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Deleting offline snapshot 715ddf12-17cb-4bef-8b00-b073db480321 of volume 08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] snapshot_file for this snap is: volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75602e1-f754-484c-a416-e1d61dac4f7f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:31 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 Jul 08 16:22:31 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:31 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9" returned: 0 in 6.411s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e7c236-36e2-4c18-bec5-e3e691a46edf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:31 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:31 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:32 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321" returned: 0 in 0.908s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fe24c1-706a-4261-931e-addcba5f1265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e611e-9521-4789-9dfc-d94a863b6a0e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:32 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 Jul 08 16:22:32 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:32 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 1.045s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:22:32 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Converted 1024.00 MB image at 159.70 MB/s Jul 08 16:22:32 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 is being set with open permissions: ugo+rw Jul 08 16:22:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:32 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 Jul 08 16:22:32 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:33 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265" returned: 0 in 0.797s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:33 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 Jul 08 16:22:33 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:33 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" released by "_copy_volume_from_snapshot" :: held 9.973s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-8d223d69-cd92-4a36-abf3-56e49775eba9" released by "_create_volume_from_snapshot" :: held 10.010s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.036s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.819s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1290169982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4952ee-483d-4d64-ab45-b41713a96965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b72b1be12b425db3647bcd8ae2253f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:13Z,use_quota=True,user_id='ce2bd3053f2741a5ba5aa3ccc43cb92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Creating volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:33 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:33 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 1073741824 Jul 08 16:22:33 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c76ed63-16bf-4ac0-89d2-1a6a151ec8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d223d69-cd92-4a36-abf3-56e49775eba9', 'volume_size': 2, 'snapshot_id': 'f553b532-2db6-4c8b-bc4f-8f78a1d7c821'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd93d0e-62c9-4ff7-8fff-906092c4ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Volume volume-8d223d69-cd92-4a36-abf3-56e49775eba9 (8d223d69-cd92-4a36-abf3-56e49775eba9): created successfully Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd93d0e-62c9-4ff7-8fff-906092c4ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (f35dec97-ff79-4f4a-9638-ab5861e06856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fab35ba4-211e-46ac-9321-4fed48f2374c tempest-VolumesSnapshotTestJSON-681252021 None] Created volume successfully. Jul 08 16:22:34 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:34 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321 Jul 08 16:22:34 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-8d223d69-cd92-4a36-abf3-56e49775eba9-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-8d223d69-cd92-4a36-abf3-56e49775eba9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:34 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 1073741824" returned: 0 in 0.980s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e730ea-f5b5-4e90-995d-4a201e9bf3a0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:34 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 Jul 08 16:22:34 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:34 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 Jul 08 16:22:34 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:34 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265.715ddf12-17cb-4bef-8b00-b073db480321" returned: 0 in 0.734s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-715ddf12-17cb-4bef-8b00-b073db480321" released by "_delete_snapshot" :: held 3.390s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" released by "delete_snapshot" :: held 3.431s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:34 devstack cinder-volume[87227]: WARNING cinder.quota [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1318256364 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1318256364, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:22:34 devstack cinder-volume[87227]: WARNING cinder.quota [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1318256364 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1318256364, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:22:34 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['216c8be1-a186-4edc-944d-9dcad0cf36a8', '983557e3-b502-48ae-97ed-3690200a2b23', 'f249c40f-4b33-4103-9584-f305630d7828', '842aa355-2ed4-46ce-9ecf-6ec196bf9c05'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['8b08edbf-abc3-440e-9266-7f51a4413133', 'dcf8573d-39bd-420c-bdf4-fd9349c580db', '87be38b6-cfab-483e-bd95-ee988ee3278a', 'e71f98d6-0912-423f-ab4b-de9c118f1b16'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c8322c77-edcb-4942-9ea9-47d9f965eb88 tempest-GroupSnapshotsTest-1956020108 None] group_snapshot ce6f7a9a-837a-4b43-af2f-1da63037fcc1: deleted successfully Jul 08 16:22:35 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d6eac2-d025-4b22-a053-cd38e46b7fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4952ee-483d-4d64-ab45-b41713a96965', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18acf8ec-c569-4301-9d6d-e5aa13fb9707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:35 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Volume volume-1f4952ee-483d-4d64-ab45-b41713a96965 (1f4952ee-483d-4d64-ab45-b41713a96965): created successfully Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18acf8ec-c569-4301-9d6d-e5aa13fb9707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Flow 'volume_create_manager' (6314c1d3-7739-4d62-ba95-4dcebf319ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-824bbdef-5ad3-4767-9bbd-9a81d224fc4b tempest-VolumesSnapshotListTestJSON-1892653814 None] Created volume successfully. Jul 08 16:22:35 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9" returned: 0 in 1.117s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:35 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9 Jul 08 16:22:35 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Creating offline snapshot a9df0a62-239b-4292-b304-f0b7e7725847 of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c1915-aa58-4f5c-b73e-3800b1842eac]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:36 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 Jul 08 16:22:36 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53a2de-cc78-48ef-8512-2966340260b7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:36 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 Jul 08 16:22:36 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:36 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d223d69-cd92-4a36-abf3-56e49775eba9" returned: 0 in 1.016s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-8d223d69-cd92-4a36-abf3-56e49775eba9" released by "delete_volume" :: held 2.182s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['d83e6b62-d122-4088-8b95-f6002038cbde', '8187249c-4a83-4195-8b9f-7bc6eae745e2', '2240d859-210e-4adb-a829-f907f5c0a074', '9ad27a2b-b05c-464f-9d3b-a7c24616dbd8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:36 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:36 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:37 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965" returned: 0 in 1.156s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:37 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 1G Jul 08 16:22:37 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:37 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265" returned: 0 in 0.970s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:37 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265 Jul 08 16:22:37 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:37 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Deleted volume successfully. Jul 08 16:22:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-884d784e-b3e0-4756-844d-ba8b6c405729 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-8d223d69-cd92-4a36-abf3-56e49775eba9-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Deleting offline snapshot f553b532-2db6-4c8b-bc4f-8f78a1d7c821 of volume 324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] snapshot_file for this snap is: volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec9325-0621-4be7-8a34-1fc6a3952d7f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:38 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:38 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:38 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08fe24c1-706a-4261-931e-addcba5f1265" returned: 0 in 0.895s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-08fe24c1-706a-4261-931e-addcba5f1265" released by "delete_volume" :: held 1.979s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b06a85-3685-4f7a-8be8-6a2f56034bf7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:38 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea Jul 08 16:22:38 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:38 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 1G" returned: 0 in 1.206s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:38 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:22:38 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:39 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 1.199s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-324fd010-4986-4ee5-924b-386b18ce19aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2ff8d-f0ba-45b8-b6a8-060e6ae21309]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:39 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:39 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 is being set with open permissions: ugo+rw Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:39 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:22:39 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:39 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:39 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:39 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" returned: 0 in 1.250s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:39 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea Jul 08 16:22:39 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:40 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 1.110s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:40 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info Jul 08 16:22:40 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:40 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 1.350s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:40 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:40 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:40 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" returned: 0 in 1.146s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-f2f168b3-18a9-4c8a-93c8-4e947cb8ffea" released by "delete_volume" :: held 2.480s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:40 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['24d2a079-ffe8-4a64-8c90-19398c330f51'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:41 devstack cinder-volume[87227]: WARNING cinder.quota [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1318256364 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1318256364, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['b1f91232-6f84-4c56-b56d-25fdbdea6648', 'fb351e63-0bca-4a83-a6e9-828760ef3942', '237d2feb-f5ea-4d5c-be99-df75fc59ceec', 'b385f8ee-832c-4190-aae3-1ab789e99601'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['0c5189f8-b3c5-46b6-91f3-e0f5f75fcf79', 'f39c405c-46a9-4833-b274-8f141c0d8034', 'a9cfe38b-0c9b-4e5c-a401-5ddda1b94351', 'bf1260b3-e4e7-4117-ac25-3e0dcc53e42d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:41 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:41 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:41 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info" returned: 0 in 1.294s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:41 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info is being set with open permissions: ugo+rw Jul 08 16:22:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:42 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info Jul 08 16:22:42 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:42 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 1.339s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:42 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821 Jul 08 16:22:42 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8e7533af-6b0e-430c-b8f0-fc46dcdd843a tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-1853005888: creating Jul 08 16:22:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8e7533af-6b0e-430c-b8f0-fc46dcdd843a tempest-GroupSnapshotsTest-1956020108 None] Group tempest-GroupSnapshotsTest-Group-1853005888: created successfully Jul 08 16:22:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8e7533af-6b0e-430c-b8f0-fc46dcdd843a tempest-GroupSnapshotsTest-1956020108 None] Create group completed successfully. Jul 08 16:22:42 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.287s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:42 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9a38bc4b-4632-4433-b3bd-32aa2e9c513d tempest-GroupSnapshotsTest-1956020108 None] Delete group completed successfully. Jul 08 16:22:43 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.info" returned: 0 in 1.047s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.890s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-63404874-677a-44ac-9ead-85bef9d9bd42 tempest-VolumesSnapshotListTestJSON-1892653814 None] Create snapshot completed successfully Jul 08 16:22:43 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa.f553b532-2db6-4c8b-bc4f-8f78a1d7c821" returned: 0 in 1.072s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-f553b532-2db6-4c8b-bc4f-8f78a1d7c821" released by "_delete_snapshot" :: held 5.109s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" released by "delete_snapshot" :: held 5.157s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['d9555f8b-02f8-4a00-8790-d1ec05963d78', '702f4c76-8dae-4efc-ba66-496ecdfe97fb', 'a5f69525-741a-47eb-9b0f-9251614e5657', '08b3b894-fcc6-428f-bec6-7ae96cdad197'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Delete snapshot completed successfully. Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d19acfb-6aff-42e5-9410-f5a09fdb35c1 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-f553b532-2db6-4c8b-bc4f-8f78a1d7c821-delete_snapshot" released by "delete_snapshot" :: held 5.359s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Creating offline snapshot 0931d0d3-6168-4884-ab71-ce8a225b0751 of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b4738-9bc4-4911-b505-26ba47efc1c8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:43 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:22:43 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (35ef1ea7-e4b6-43da-bec4-abbe071ee3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161ad3c-eef8-4bea-b082-894148505292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161ad3c-eef8-4bea-b082-894148505292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827046782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50f139ea-c8c7-4b4f-8388-a27e5b0efef5,host='devstack@QuobyteHD#QuobyteHD',id=4c351be2-a76b-49f6-84c5-532381fff8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:44Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3000d43-f814-4dcc-ac6a-ebceb6450c9c),volume_type_id=f3000d43-f814-4dcc-ac6a-ebceb6450c9c)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd57aab2-0a26-4357-8b55-3dcffc84be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd57aab2-0a26-4357-8b55-3dcffc84be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80772e5-6c42-4353-8662-94d5377dd904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80772e5-6c42-4353-8662-94d5377dd904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c351be2-a76b-49f6-84c5-532381fff8c8', 'volume_name': 'volume-4c351be2-a76b-49f6-84c5-532381fff8c8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffcc65d-1ced-4602-b041-c65307ba1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffcc65d-1ced-4602-b041-c65307ba1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72076f3d-c93c-48f6-916e-9644f00f2dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:44 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Volume 4c351be2-a76b-49f6-84c5-532381fff8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c351be2-a76b-49f6-84c5-532381fff8c8', 'volume_size': 1} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-324fd010-4986-4ee5-924b-386b18ce19aa-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-324fd010-4986-4ee5-924b-386b18ce19aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8a8d1-4cc9-4169-9ee5-0837beadd8b7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:44 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 1.014s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:44 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:44 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:44 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 1G Jul 08 16:22:44 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:45 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 0.859s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:45 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa Jul 08 16:22:45 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:45 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 1G" returned: 0 in 0.993s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:45 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:22:45 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:46 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-324fd010-4986-4ee5-924b-386b18ce19aa" returned: 0 in 0.761s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-324fd010-4986-4ee5-924b-386b18ce19aa" released by "delete_volume" :: held 1.704s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['01a69860-4f74-4be2-98dd-ae3f73e8f4f2', '31383478-9767-4203-afe2-8b9afeb13424', '26f70623-956d-44a1-8f61-fa890a2a4fb9', '50bd7705-2d49-44f6-9089-02366ac0dfa4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:46 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:22:46 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:46 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:46 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 is being set with open permissions: ugo+rw Jul 08 16:22:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:46 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:22:46 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:47 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:22:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Deleted volume successfully. Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44ced3b8-924b-40ca-8b41-17767c87b7a2 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-324fd010-4986-4ee5-924b-386b18ce19aa-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:47 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.901s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.850s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50f139ea-c8c7-4b4f-8388-a27e5b0efef5,created_at=2026-07-08T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827046782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50f139ea-c8c7-4b4f-8388-a27e5b0efef5,host='devstack@QuobyteHD#QuobyteHD',id=4c351be2-a76b-49f6-84c5-532381fff8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea4de7338a4843ba43e9c35cbb75dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:44Z,use_quota=True,user_id='bf975c334e904302bfc931852cbcd9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3000d43-f814-4dcc-ac6a-ebceb6450c9c),volume_type_id=f3000d43-f814-4dcc-ac6a-ebceb6450c9c)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Creating volume 4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:47 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:47 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 1073741824 Jul 08 16:22:47 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (28db5c6f-5173-418f-a127-68cdd399f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fcd205-33d6-4579-9f43-1f5ca7e35914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-de754d95-d336-4b21-8ee3-ac71dc6fa636 tempest-VolumesSnapshotListTestJSON-1892653814 None] Create snapshot completed successfully Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fcd205-33d6-4579-9f43-1f5ca7e35914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737083528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26f5b3e-283c-4f49-85ad-1e54c2422fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:48Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668360e1-c7bd-4d05-a6c4-bb56f3e846be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668360e1-c7bd-4d05-a6c4-bb56f3e846be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7110e0-f144-4fa6-ac93-30ab7952e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7110e0-f144-4fa6-ac93-30ab7952e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26f5b3e-283c-4f49-85ad-1e54c2422fc9', 'volume_name': 'volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d1bf8-331b-421e-92d4-f016d67027ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d1bf8-331b-421e-92d4-f016d67027ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d6ba6c-697d-4ce1-8a93-663f42cb8473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Volume e26f5b3e-283c-4f49-85ad-1e54c2422fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9', 'volume_size': 1} Jul 08 16:22:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:48 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 1073741824" returned: 0 in 0.891s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:48 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 Jul 08 16:22:48 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:49 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8" returned: 0 in 0.705s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737083528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26f5b3e-283c-4f49-85ad-1e54c2422fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:22:48Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Creating volume e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:22:49 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72076f3d-c93c-48f6-916e-9644f00f2dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c351be2-a76b-49f6-84c5-532381fff8c8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:49 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 1073741824 Jul 08 16:22:49 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01de747-8e03-47a6-92cf-5921008ce233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Volume volume-4c351be2-a76b-49f6-84c5-532381fff8c8 (4c351be2-a76b-49f6-84c5-532381fff8c8): created successfully Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01de747-8e03-47a6-92cf-5921008ce233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Flow 'volume_create_manager' (35ef1ea7-e4b6-43da-bec4-abbe071ee3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7335c656-d0d1-4696-96f4-7eaef2dfb5f4 tempest-GroupSnapshotsTest-1956020108 None] Created volume successfully. Jul 08 16:22:50 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 1073741824" returned: 0 in 0.845s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:50 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:22:50 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] GroupSnapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: creating. Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Group snapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: creating. {{(pid=87227) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:50 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.722s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d6ba6c-697d-4ce1-8a93-663f42cb8473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdfa6df-7d84-49f8-bc5b-0331e969f9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Creating offline snapshot d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Volume volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 (e26f5b3e-283c-4f49-85ad-1e54c2422fc9): created successfully Jul 08 16:22:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdfa6df-7d84-49f8-bc5b-0331e969f9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (28db5c6f-5173-418f-a127-68cdd399f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db1d49-50cc-4b18-a7fd-21b6e478647b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6406609f-f7e6-4581-b0ac-89152348c161 tempest-VolumesSnapshotTestJSON-681252021 None] Created volume successfully. Jul 08 16:22:51 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:22:51 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:51 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:51 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb 1G Jul 08 16:22:51 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:22:52 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb 1G" returned: 0 in 0.861s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:52 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb Jul 08 16:22:52 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:53 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" returned: 0 in 0.693s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:53 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb is being set with open permissions: ugo+rw Jul 08 16:22:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:53 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb Jul 08 16:22:53 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:54 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" returned: 0 in 0.646s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.333s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Creating offline snapshot 1b063909-4d1f-4db3-a34d-73902b5a5be4 of volume 4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2e34e7da-ea8e-4673-b643-f2ac9cdbcef1 tempest-VolumesSnapshotListTestJSON-1892653814 None] Create snapshot completed successfully Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c1e355-5f6b-4baf-b763-971b210b39c6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:54 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 Jul 08 16:22:54 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:54 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:54 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 1G Jul 08 16:22:54 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Deleting offline snapshot d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] snapshot_file for this snap is: volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[87905ddb-399a-4681-891c-0d87a029d8b2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:55 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb Jul 08 16:22:55 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:55 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 1G" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c351be2-a76b-49f6-84c5-532381fff8c8 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:55 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c351be2-a76b-49f6-84c5-532381fff8c8 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 Jul 08 16:22:55 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:56 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[740444e6-725c-42cf-b38a-2af56e2c2c45]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:56 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:22:56 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:56 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c351be2-a76b-49f6-84c5-532381fff8c8 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:56 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:56 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 Jul 08 16:22:56 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:56 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.806s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:22:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:56 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb Jul 08 16:22:56 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:57 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4" returned: 0 in 0.663s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:57 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info Jul 08 16:22:57 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:57 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" returned: 0 in 0.835s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:57 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb Jul 08 16:22:57 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:57 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:57 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 16:22:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:57 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info Jul 08 16:22:57 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:58 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb" released by "_delete_snapshot" :: held 3.232s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" released by "delete_snapshot" :: held 3.257s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:58 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.info" returned: 0 in 0.662s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.474s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.554s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Creating offline snapshot 3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 of volume e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15f49b-9f76-414b-8362-65f78c571799]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Created reservations ['2ad45641-b491-4b24-9f87-460b14d1a018', '035957e3-5c28-422e-8c0d-bc4e4a709c87', '151ff1c8-82ce-4dc7-8b5f-a868ff4e8bdd', 'cd64bdbc-37d5-4888-8f80-591c3eb561e9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:22:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-424e08d9-0299-47cf-9bfa-affe8f2e041e tempest-GroupSnapshotsTest-1956020108 None] group_snapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: created successfully Jul 08 16:22:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Delete snapshot completed successfully. Jul 08 16:22:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7cc8c249-563f-4dac-af2b-8d4e412f0c10 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-d60fb7cf-bd25-4fad-8051-f2b5a02bb1fb-delete_snapshot" released by "delete_snapshot" :: held 3.538s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:22:58 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:22:58 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] group_snapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: deleting Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] group_snapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: deleting {{(pid=87227) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-1b063909-4d1f-4db3-a34d-73902b5a5be4" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-1b063909-4d1f-4db3-a34d-73902b5a5be4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Deleting offline snapshot 1b063909-4d1f-4db3-a34d-73902b5a5be4 of volume 4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] snapshot_file for this snap is: volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82130c-a724-42ee-be1c-73202c4e5320]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:59 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 0.928s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:22:59 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 1G Jul 08 16:22:59 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:59 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 Jul 08 16:22:59 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-0931d0d3-6168-4884-ab71-ce8a225b0751-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-0931d0d3-6168-4884-ab71-ce8a225b0751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-0931d0d3-6168-4884-ab71-ce8a225b0751" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-0931d0d3-6168-4884-ab71-ce8a225b0751" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Deleting offline snapshot 0931d0d3-6168-4884-ab71-ce8a225b0751 of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] snapshot_file for this snap is: volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[40094b56-9618-4259-90f1-34aafb288d34]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:22:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:00 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:23:00 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:00 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4" returned: 0 in 0.898s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c351be2-a76b-49f6-84c5-532381fff8c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0793ac3d-9de1-4b4c-91cd-5d6ab522d92f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:00 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 Jul 08 16:23:00 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:00 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 1G" returned: 0 in 1.010s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:00 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:00 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:00 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef00ba7-4cd8-4b14-b078-54acd2e8f442]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:01 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:23:01 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:01 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8" returned: 0 in 0.914s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:01 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 Jul 08 16:23:01 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:01 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 0.828s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:01 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 is being set with open permissions: ugo+rw Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:01 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:01 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:01 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 0.879s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:01 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:23:01 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:02 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 0.710s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:02 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:02 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info Jul 08 16:23:02 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:02 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4 Jul 08 16:23:02 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:02 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.967s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:02 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751 Jul 08 16:23:02 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (20617a66-c15f-413c-9944-b0e7096584e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d491a7b-1cb4-49d6-88d6-a4bb7e53989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:02 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:02 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info is being set with open permissions: ugo+rw Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d491a7b-1cb4-49d6-88d6-a4bb7e53989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-325703019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5eab2-aed0-4865-9d37-5a35bb21f39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:03Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8035d8-1188-4523-be7c-f1106d8d1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:02 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info Jul 08 16:23:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8035d8-1188-4523-be7c-f1106d8d1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:02 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6274119-6a9b-4df5-aae6-8c9b615e21d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6274119-6a9b-4df5-aae6-8c9b615e21d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe5eab2-aed0-4865-9d37-5a35bb21f39b', 'volume_name': 'volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:03 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9984ae4-6057-4233-a6b8-e386a9f3ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9984ae4-6057-4233-a6b8-e386a9f3ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32c82db-8075-456b-9f3a-a940259e3f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Volume 9fe5eab2-aed0-4865-9d37-5a35bb21f39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b', 'volume_size': 1} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8.1b063909-4d1f-4db3-a34d-73902b5a5be4" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-1b063909-4d1f-4db3-a34d-73902b5a5be4" released by "_delete_snapshot" :: held 3.656s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" released by "delete_snapshot" :: held 3.686s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:03 devstack cinder-volume[87227]: WARNING cinder.quota [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-205471094 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-205471094, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:23:03 devstack cinder-volume[87227]: WARNING cinder.quota [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-205471094 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-205471094, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['880112de-8487-412b-af9b-4bf745bffdd8', '05e0b74d-6f18-48bd-b0ec-bd45ed732d55', '861f1954-8f4c-4f02-8dc8-10607ee6e220', 'b0ce5330-2f42-47a9-a8c1-7eb7df306872'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7d308298-73bf-478c-a8ac-0152e9d318bf tempest-GroupSnapshotsTest-1956020108 None] group_snapshot 36a7ff0e-eafa-4405-98a1-f3280937796d: deleted successfully Jul 08 16:23:03 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.0931d0d3-6168-4884-ab71-ce8a225b0751" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-0931d0d3-6168-4884-ab71-ce8a225b0751" released by "_delete_snapshot" :: held 3.607s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" released by "delete_snapshot" :: held 3.642s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Created reservations ['f33b743a-f735-4b8d-a2d0-92ce1e7d0884', '7ce9b17d-9dd8-4dc6-bc51-59609e2633a1', '5f46a9c4-e599-4d72-8683-b399effc9c82', '61816155-feb7-4307-8eae-e651560ae23d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Delete snapshot completed successfully. Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bfd5a470-73a4-49cc-8813-1083cbe7de62 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-0931d0d3-6168-4884-ab71-ce8a225b0751-delete_snapshot" released by "delete_snapshot" :: held 3.814s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:03 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.info" returned: 0 in 0.693s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.155s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-325703019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5eab2-aed0-4865-9d37-5a35bb21f39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:03Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Creating volume 9fe5eab2-aed0-4865-9d37-5a35bb21f39b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:23:03 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:23:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:03 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b 1073741824 Jul 08 16:23:03 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dc5ac943-78d2-4ad4-a111-429e9656892d tempest-VolumesSnapshotTestJSON-681252021 None] Create snapshot completed successfully Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-a9df0a62-239b-4292-b304-f0b7e7725847-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[960fdeea-98c1-494e-936c-3f3c391b6c9f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-a9df0a62-239b-4292-b304-f0b7e7725847-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-a9df0a62-239b-4292-b304-f0b7e7725847" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-a9df0a62-239b-4292-b304-f0b7e7725847" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Deleting offline snapshot a9df0a62-239b-4292-b304-f0b7e7725847 of volume 1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] snapshot_file for this snap is: volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ab4ec-d917-4c79-8274-db7b1081629a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:04 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 Jul 08 16:23:04 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:04 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:23:04 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:04 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b 1073741824" returned: 0 in 0.888s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:04 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b Jul 08 16:23:04 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:04 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:05 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8 Jul 08 16:23:05 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:05 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 0.852s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4952ee-483d-4d64-ab45-b41713a96965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[92838012-f2b3-457a-b8d0-2fb4abb62b48]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:05 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 Jul 08 16:23:05 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:23:05 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" returned: 0 in 0.825s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32c82db-8075-456b-9f3a-a940259e3f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93552fe-ea10-4cac-9c7b-1059ae96591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (9d983dce-f912-4648-ae79-90ced3bfd0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ea28f6-b6fe-4d3f-9545-d3a0bff508f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Volume volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b (9fe5eab2-aed0-4865-9d37-5a35bb21f39b): created successfully Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93552fe-ea10-4cac-9c7b-1059ae96591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (20617a66-c15f-413c-9944-b0e7096584e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ea28f6-b6fe-4d3f-9545-d3a0bff508f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1822794516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d536cb1a-5531-49e3-91f1-7f314a59a854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0d906b570d41bc9ad1ba8f278d9f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a76ea82-14cb-48f6-9c4a-2e49ecded0e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:05Z,use_quota=True,user_id='4c1aed4c927f4c1e850b49ae08675ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdfb476-f100-4cfa-bf23-d04254594629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdfb476-f100-4cfa-bf23-d04254594629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ede52-f88c-408a-809b-33d6fe2c3e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ede52-f88c-408a-809b-33d6fe2c3e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd536cb1a-5531-49e3-91f1-7f314a59a854', 'volume_name': 'volume-d536cb1a-5531-49e3-91f1-7f314a59a854', 'volume_size': 1, 'snapshot_id': '3a76ea82-14cb-48f6-9c4a-2e49ecded0e9'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e34768-6ed0-4168-8208-214c84cf6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e34768-6ed0-4168-8208-214c84cf6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88db863-6155-49cd-80e9-c6e68fa64aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Volume d536cb1a-5531-49e3-91f1-7f314a59a854: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d536cb1a-5531-49e3-91f1-7f314a59a854', 'volume_size': 1, 'snapshot_id': '3a76ea82-14cb-48f6-9c4a-2e49ecded0e9'} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-d536cb1a-5531-49e3-91f1-7f314a59a854" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1152fc88-b77b-4964-9db2-08ac16685761 tempest-AttachVolumeTestJSON-144956780 None] Created volume successfully. Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-d536cb1a-5531-49e3-91f1-7f314a59a854" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Creating volume d536cb1a-5531-49e3-91f1-7f314a59a854 from snapshot 3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] snapshot: 3a76ea82-14cb-48f6-9c4a-2e49ecded0e9, volume: d536cb1a-5531-49e3-91f1-7f314a59a854, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8e30c-a9c6-440a-8707-daecf8d8729b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:05 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:05 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:05 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4c351be2-a76b-49f6-84c5-532381fff8c8" returned: 0 in 0.848s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Lock "cinder-quobyte-4c351be2-a76b-49f6-84c5-532381fff8c8" released by "delete_volume" :: held 1.799s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['ea01e2c2-5aa4-4672-8f5d-266a800a27ce'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:05 devstack cinder-volume[87227]: WARNING cinder.quota [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-205471094 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-205471094, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:23:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Created reservations ['5865360e-97b9-43da-ae5a-651a80f14107', '412614b3-9483-4f84-a443-496580f2eb1f', 'bd2dd219-fe9f-4bf8-b08b-6845f6e76e4f', '762cb9d2-128e-43a5-861b-4677e3d4c889'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:06 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965" returned: 0 in 0.926s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:06 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:23:06 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:06 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:06 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:06 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 0.995s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d437ce-80eb-4e29-a37c-9c0173e1fa4d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:23:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:06 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:06 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.819s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:06 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3e7bc9e0-bb47-49a5-a35b-e348f62fd130 tempest-GroupSnapshotsTest-1956020108 None] Delete group completed successfully. Jul 08 16:23:06 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847 Jul 08 16:23:06 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:07 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:07 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 Jul 08 16:23:07 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:07 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965.a9df0a62-239b-4292-b304-f0b7e7725847" returned: 0 in 0.746s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-a9df0a62-239b-4292-b304-f0b7e7725847" released by "_delete_snapshot" :: held 3.561s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" released by "delete_snapshot" :: held 3.586s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Created reservations ['0a643e7e-2978-4c5a-8d5a-200996743662', '6008fcd8-8a69-4edd-be8f-ae11005caa42', 'b777955b-d1ff-4916-bae4-1db09c46226d', '1fe37246-c0a4-4d58-bf2b-402fb6314eb5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Delete snapshot completed successfully. Jul 08 16:23:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-122cc99a-f3e0-4cfa-a224-044c00415d85 tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-a9df0a62-239b-4292-b304-f0b7e7725847-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-1f4952ee-483d-4d64-ab45-b41713a96965-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-1f4952ee-483d-4d64-ab45-b41713a96965-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" acquired by "delete_volume" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd1f97f-eda8-48f4-ab6e-0c7f71190ff4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:09 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 Jul 08 16:23:09 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:11 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965" returned: 0 in 2.317s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:11 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965 Jul 08 16:23:11 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:12 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f4952ee-483d-4d64-ab45-b41713a96965" returned: 0 in 1.300s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-quobyte-1f4952ee-483d-4d64-ab45-b41713a96965" released by "delete_volume" :: held 3.822s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Created reservations ['667523b1-ecdf-4916-bd24-5e23b667ea61', 'd638238d-2ff0-4568-b2c0-66a7e1536dfb', '795b69c7-7bf9-4b83-8db6-5aabf0e2ef66', '70592c8e-c099-4c89-b544-b93ca96b1cf5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:12 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:12 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:14 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854" returned: 0 in 6.565s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5fa56a-a300-456f-8db1-733ea217d6d0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:14 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.430s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Deleted volume successfully. Jul 08 16:23:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-bb3f8688-eed4-4c80-a113-6722315825bf tempest-VolumesSnapshotListTestJSON-1892653814 None] Lock "cinder-1f4952ee-483d-4d64-ab45-b41713a96965-delete_volume" released by "delete_volume" :: held 5.736s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:14 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:23:14 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:15 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 1.037s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:23:15 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Converted 1024.00 MB image at 155.94 MB/s Jul 08 16:23:15 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 is being set with open permissions: ugo+rw Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:15 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 Jul 08 16:23:15 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:15 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" released by "_copy_volume_from_snapshot" :: held 10.310s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-d536cb1a-5531-49e3-91f1-7f314a59a854" released by "_create_volume_from_snapshot" :: held 10.348s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.369s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.247s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dae502-f290-4930-a8a9-bcd0f8302cd7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88db863-6155-49cd-80e9-c6e68fa64aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d536cb1a-5531-49e3-91f1-7f314a59a854', 'volume_size': 1, 'snapshot_id': '3a76ea82-14cb-48f6-9c4a-2e49ecded0e9'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88af7770-3019-497d-81b3-1048b0bb48af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Volume volume-d536cb1a-5531-49e3-91f1-7f314a59a854 (d536cb1a-5531-49e3-91f1-7f314a59a854): created successfully Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88af7770-3019-497d-81b3-1048b0bb48af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Flow 'volume_create_manager' (9d983dce-f912-4648-ae79-90ced3bfd0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9af033db-91d8-4d7a-9450-ad7e187cd2d7 tempest-VolumesSnapshotTestJSON-681252021 None] Created volume successfully. Jul 08 16:23:16 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b Jul 08 16:23:16 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-d536cb1a-5531-49e3-91f1-7f314a59a854-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-d536cb1a-5531-49e3-91f1-7f314a59a854-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d10b9a-e782-496e-ae1a-0f3cc142011b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:16 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 Jul 08 16:23:16 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:16 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" returned: 0 in 0.984s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbe955e8-5b51-49a3-b7bc-aa23d5f0f56c', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:23:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-3ea821a2-d9d0-48cc-8cae-c411d0525f1f req-f38c86cc-44b4-456c-8b6b-8a5f983cd50a tempest-AttachVolumeTestJSON-144956780 None] attachment_update completed successfully. Jul 08 16:23:17 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854" returned: 0 in 0.983s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:17 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854 Jul 08 16:23:17 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:18 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-d536cb1a-5531-49e3-91f1-7f314a59a854" returned: 0 in 0.845s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-d536cb1a-5531-49e3-91f1-7f314a59a854" released by "delete_volume" :: held 1.909s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['e9b94c36-157e-4577-8799-3cc2846b9a37', '950169f9-1fef-405d-8421-a72f96da52f0', '5dfabcd4-5368-47f4-a8da-967d9956b271', 'f0417eea-e9ab-4a39-ac9f-a453ba0591ff'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:18 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:18 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Deleting offline snapshot 3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 of volume e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] snapshot_file for this snap is: volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986edcd-116c-4905-9e8c-5c98d2d50ff0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:19 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:19 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:19 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:19 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:19 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Deleted volume successfully. Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=124,cinder:INSERT=37,cinder:UPDATE=133,cinder:DELETE=5 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:23:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d031bdc5-a2fb-44d6-a578-046de9647a6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-d536cb1a-5531-49e3-91f1-7f314a59a854-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:19 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 0.935s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7877725e-83b2-417d-8dd2-4a2b76aba65a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:20 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:23:20 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:20 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.917s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:23:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:23:21 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 0.955s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:21 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:21 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:22 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 1.079s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:22 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9 Jul 08 16:23:22 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:22 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9.3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" returned: 0 in 0.846s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:22 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=117,cinder:UPDATE=125,cinder:DELETE=9,cinder:INSERT=29 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:23:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9" released by "_delete_snapshot" :: held 4.007s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" released by "delete_snapshot" :: held 4.055s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:23 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['1a852c69-2cae-484b-b36e-1d210201232a', '14eb8fd3-302f-46b9-af18-e9a96d9ff0d6', '7c8758f5-26cb-477e-bcc1-18d85119354f', '36451732-aac5-49f7-a2dd-54c33a9730e3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Delete snapshot completed successfully. Jul 08 16:23:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ce67ea0-6888-4a9f-8916-f173b83ccb6d tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-3a76ea82-14cb-48f6-9c4a-2e49ecded0e9-delete_snapshot" released by "delete_snapshot" :: held 4.356s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-e26f5b3e-283c-4f49-85ad-1e54c2422fc9-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-e26f5b3e-283c-4f49-85ad-1e54c2422fc9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a369d88-8e9f-4e92-a03a-522b956007aa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:24 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:23:24 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:25 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 1.034s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:25 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9 Jul 08 16:23:25 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:26 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" returned: 0 in 0.933s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-e26f5b3e-283c-4f49-85ad-1e54c2422fc9" released by "delete_volume" :: held 2.067s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['63d6547b-6f15-4be2-844d-d48cd6d5d9ba', '072d6af2-3154-4ff4-86dc-3952fb168f66', 'aa0ee911-28fb-416b-86d3-c9637c4b6257', 'b2613a91-99a1-4c03-a2f7-72560cae9ec1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:26 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:26 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:27 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.885s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:27 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Deleted volume successfully. Jul 08 16:23:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-89775e63-9fe3-41f1-b72f-996b5023b2b3 tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-e26f5b3e-283c-4f49-85ad-1e54c2422fc9-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-3f552eee-e226-4851-b864-0077f06b69f6-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-3f552eee-e226-4851-b864-0077f06b69f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:28 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0f609-088d-4510-9e06-a14d3f617f8a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:28 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 Jul 08 16:23:28 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:29 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6" returned: 0 in 1.099s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:29 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6 Jul 08 16:23:29 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:30 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3f552eee-e226-4851-b864-0077f06b69f6" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-quobyte-3f552eee-e226-4851-b864-0077f06b69f6" released by "delete_volume" :: held 2.005s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Created reservations ['8f2b4ff9-fc79-4567-a3af-a75a753f5699', '17adf61e-2946-4f4e-98ae-5b9b269f894f', 'da0c7219-1c4d-4266-a2e0-a8bdc6d5bda4', '6fc208a9-674a-47bd-b28f-f0286d6f956f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:30 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:30 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:30 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:30 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Deleted volume successfully. Jul 08 16:23:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5ee09a7b-f6aa-40a9-894c-02d29cf531ea tempest-VolumesSnapshotTestJSON-681252021 None] Lock "cinder-3f552eee-e226-4851-b864-0077f06b69f6-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:40 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:23:40 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Flow 'volume_create_manager' (2dce9996-6f76-4f2a-9b62-3db16e1f587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494fa281-3edb-47ee-969d-79fbd9007920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494fa281-3edb-47ee-969d-79fbd9007920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-804737030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc84a90-6a64-435a-a3a3-2d76781346b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5645dceffba243fa8e6c983daa8cd5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:43Z,use_quota=True,user_id='c1f77ffc84f448d69549d5f40eea1a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a897a03c-1dbf-4f72-81dc-d8998bbc7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a897a03c-1dbf-4f72-81dc-d8998bbc7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c42220-1af0-414c-8f1f-1186519cfdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c42220-1af0-414c-8f1f-1186519cfdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc84a90-6a64-435a-a3a3-2d76781346b0', 'volume_name': 'volume-6cc84a90-6a64-435a-a3a3-2d76781346b0', 'volume_size': 2}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc238e2-5cf5-47cf-a886-83ef830deb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc238e2-5cf5-47cf-a886-83ef830deb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca29573c-6589-44d5-821c-ba68cf53bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Volume 6cc84a90-6a64-435a-a3a3-2d76781346b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc84a90-6a64-435a-a3a3-2d76781346b0', 'volume_size': 2} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-804737030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc84a90-6a64-435a-a3a3-2d76781346b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5645dceffba243fa8e6c983daa8cd5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:43Z,use_quota=True,user_id='c1f77ffc84f448d69549d5f40eea1a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Creating volume 6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:23:42 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:23:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 2147483648 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:23:43 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 2147483648 Jul 08 16:23:43 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Flow 'volume_create_manager' (a34829c8-c831-4bf8-8965-ac775dfc069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a745857-a136-4a95-a61f-f8b7e797e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a745857-a136-4a95-a61f-f8b7e797e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1637207064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a4f013dc0949ef84486046f40081fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:43Z,use_quota=True,user_id='ccf7839b026d40469e6173d885e75fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0dd7c52-4d12-4348-b977-d6084344f0ef),volume_type_id=c0dd7c52-4d12-4348-b977-d6084344f0ef)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2e31b9-ba66-46b4-9902-b87d80345989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2e31b9-ba66-46b4-9902-b87d80345989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061b479-1425-4458-93ec-86ad53f4fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061b479-1425-4458-93ec-86ad53f4fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a', 'volume_name': 'volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d25527-3024-422a-8f0b-5b173c5ae0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d25527-3024-422a-8f0b-5b173c5ae0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a796f84-a1b7-4c93-93e6-2316a65d1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Volume e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a', 'volume_size': 1} Jul 08 16:23:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:44 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 2147483648" returned: 0 in 1.009s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:44 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 Jul 08 16:23:44 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:44 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1637207064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a4f013dc0949ef84486046f40081fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:43Z,use_quota=True,user_id='ccf7839b026d40469e6173d885e75fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0dd7c52-4d12-4348-b977-d6084344f0ef),volume_type_id=c0dd7c52-4d12-4348-b977-d6084344f0ef)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Creating volume e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:23:44 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca29573c-6589-44d5-821c-ba68cf53bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc84a90-6a64-435a-a3a3-2d76781346b0', 'volume_size': 2}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:44 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a 1073741824 Jul 08 16:23:44 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88985081-3e69-41cc-9ca5-fda0663ff0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Volume volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 (6cc84a90-6a64-435a-a3a3-2d76781346b0): created successfully Jul 08 16:23:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88985081-3e69-41cc-9ca5-fda0663ff0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Flow 'volume_create_manager' (2dce9996-6f76-4f2a-9b62-3db16e1f587f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:45 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-08dfd024-3e30-4461-b82b-d02859e5533f tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Created volume successfully. Jul 08 16:23:45 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a 1073741824" returned: 0 in 1.048s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:46 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a Jul 08 16:23:46 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:47 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" returned: 0 in 0.974s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.740s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a796f84-a1b7-4c93-93e6-2316a65d1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deef0ea1-dea1-4a2c-a9ea-79ed0f791bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Creating offline snapshot 9106f5c2-bc9c-418d-a734-38c12c57c11f of volume 6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:23:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Volume volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a (e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a): created successfully Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deef0ea1-dea1-4a2c-a9ea-79ed0f791bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Flow 'volume_create_manager' (a34829c8-c831-4bf8-8965-ac775dfc069f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[909eecfc-9b4c-418d-a1d0-696db71a9e14]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-89ee4388-f19d-4a4b-bfba-8f5e9b0521af tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Created volume successfully. Jul 08 16:23:47 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 Jul 08 16:23:47 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:47 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0" returned: 0 in 0.840s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f 2G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:48 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f 2G Jul 08 16:23:48 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:48 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:48 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:49 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f 2G" returned: 0 in 1.097s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:49 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f Jul 08 16:23:49 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:49 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.835s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:49 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-479f4b80-4804-423a-9b93-7d79009002c7 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Retype volume completed successfully. Jul 08 16:23:50 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:50 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f is being set with open permissions: ugo+rw Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:50 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f Jul 08 16:23:50 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "cinder-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "cinder-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "cinder-quobyte-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "cinder-quobyte-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da1c2b3-d533-4a85-bd06-5272afa48978]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:50 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a Jul 08 16:23:50 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:50 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f" returned: 0 in 0.961s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:51 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info Jul 08 16:23:51 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:51 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" returned: 0 in 1.178s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:51 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a Jul 08 16:23:51 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:51 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:51 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info is being set with open permissions: ugo+rw Jul 08 16:23:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:51 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info Jul 08 16:23:51 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:52 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" returned: 0 in 0.686s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "cinder-quobyte-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a" released by "delete_volume" :: held 1.937s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:52 devstack cinder-volume[87227]: WARNING cinder.quota [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:23:52 devstack cinder-volume[87227]: WARNING cinder.quota [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Created reservations ['172a2ee8-de0f-49e0-81fa-f0231e87e15e', '319e5fcf-23dd-456f-bd15-0cfdbc9cd781', '5c7862be-2791-404c-bdb2-b6af058012c3', '4b601e68-4988-42f2-a04f-456cb29b49da'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:52 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:52 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:52 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.info" returned: 0 in 0.686s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.434s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d588e528-953c-4700-84d1-b3ec6db8e297 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Create snapshot completed successfully Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "cinder-9106f5c2-bc9c-418d-a734-38c12c57c11f-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-9106f5c2-bc9c-418d-a734-38c12c57c11f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "cinder-quobyte-9106f5c2-bc9c-418d-a734-38c12c57c11f" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-9106f5c2-bc9c-418d-a734-38c12c57c11f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Deleting offline snapshot 9106f5c2-bc9c-418d-a734-38c12c57c11f of volume 6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] snapshot_file for this snap is: volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3506fda-21f0-4c6d-b5ca-2851b9cfffe2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:53 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f Jul 08 16:23:53 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:53 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.838s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Deleted volume successfully. Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b3825fb0-4429-4b4a-bf67-7ec702742196 tempest-VolumeRetypeWithoutMigrationTest-953940383 None] Lock "cinder-e4c1455d-79f1-4c6a-90cd-b228f4ae5e6a-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:53 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f" returned: 0 in 0.794s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc84a90-6a64-435a-a3a3-2d76781346b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8243b5d3-5a05-4337-b986-89ae0e860850]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:53 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 Jul 08 16:23:53 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:54 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0" returned: 0 in 0.864s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:54 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f Jul 08 16:23:54 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:55 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f" returned: 0 in 0.950s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:55 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f Jul 08 16:23:55 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:56 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0.9106f5c2-bc9c-418d-a734-38c12c57c11f" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-9106f5c2-bc9c-418d-a734-38c12c57c11f" released by "_delete_snapshot" :: held 3.537s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" released by "delete_snapshot" :: held 3.574s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:56 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Created reservations ['559a00af-103a-475f-a235-c6ee8b8b9342', '126343ea-ef87-4c2a-aff7-f345bb687c30', '6f483924-4649-405d-bea2-0237d08d5989', '37c0b7a7-c280-4dea-bfa4-97e69f805ab6'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Delete snapshot completed successfully. Jul 08 16:23:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-18a297ce-1085-4fcd-b141-a74785dda62b tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-9106f5c2-bc9c-418d-a734-38c12c57c11f-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "cinder-6cc84a90-6a64-435a-a3a3-2d76781346b0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-6cc84a90-6a64-435a-a3a3-2d76781346b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b18ea-2fb6-4591-b069-8abaef7e6484]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:23:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:57 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 Jul 08 16:23:57 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:58 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0" returned: 0 in 0.809s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:58 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0 Jul 08 16:23:58 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Flow 'volume_create_manager' (a63fd6c1-27c0-4bc4-bb5e-0577f18a5b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b73fb1-094c-45bd-b68d-e2cc479a8f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b73fb1-094c-45bd-b68d-e2cc479a8f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1094798007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9792382321044390a7e0a6fb3b6e3949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:59Z,use_quota=True,user_id='62a370e0f0dd4cd5a3bee5e8ce3d6397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9481a4-9888-4d00-939f-20e0ef95de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9481a4-9888-4d00-939f-20e0ef95de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c9e55c-7609-4279-96f3-d1979232622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c9e55c-7609-4279-96f3-d1979232622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c', 'volume_name': 'volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe217876-4d16-4fb0-a043-821e767bbd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe217876-4d16-4fb0-a043-821e767bbd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801901ab-7105-4530-9e1b-115f90f72080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:23:58 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Volume cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c', 'volume_size': 1} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1094798007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9792382321044390a7e0a6fb3b6e3949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:23:59Z,use_quota=True,user_id='62a370e0f0dd4cd5a3bee5e8ce3d6397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Creating volume cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:23:58 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:58 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c 1073741824 Jul 08 16:23:58 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:58 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6cc84a90-6a64-435a-a3a3-2d76781346b0" returned: 0 in 0.769s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-quobyte-6cc84a90-6a64-435a-a3a3-2d76781346b0" released by "delete_volume" :: held 1.664s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Created reservations ['a6374739-54ae-4294-a8c4-82b162d21311', '140492e7-43fa-40fd-a166-549b716c81b6', 'aa10d7a1-382a-4687-91ef-8e23b87de22a', '53f2f4e1-46a6-4e4d-bfb5-7a82ac4b221e'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:23:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:59 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:23:59 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:59 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c 1073741824" returned: 0 in 1.047s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:23:59 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c Jul 08 16:23:59 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:23:59 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 08 16:23:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.992s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:23:59 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:23:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Deleted volume successfully. Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82ae11c1-f49a-46d8-9634-367fee6352a7 tempest-VolumesSnapshotNegativeTestJSON-1922765653 None] Lock "cinder-6cc84a90-6a64-435a-a3a3-2d76781346b0-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:00 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801901ab-7105-4530-9e1b-115f90f72080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f541a35e-67e3-4a7d-919a-8f525a630bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:00 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Volume volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c (cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c): created successfully Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f541a35e-67e3-4a7d-919a-8f525a630bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Flow 'volume_create_manager' (a63fd6c1-27c0-4bc4-bb5e-0577f18a5b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bee54b72-9e31-4b90-a13c-cd2738526b2a tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Created volume successfully. Jul 08 16:24:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-86b01087-526f-43f8-bd5d-a17c27879fec req-c5f9ca01-665b-43f0-9535-d8d5f9077297 tempest-AttachVolumeTestJSON-144956780 None] Terminate volume connection completed successfully. Jul 08 16:24:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-86b01087-526f-43f8-bd5d-a17c27879fec req-c5f9ca01-665b-43f0-9535-d8d5f9077297 tempest-AttachVolumeTestJSON-144956780 None] Deleting attachment dbe955e8-5b51-49a3-b7bc-aa23d5f0f56c. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:24:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Creating offline snapshot d4b07ca3-8a50-40ce-a3da-5583a51d80e2 of volume cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:24:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdcae26-866e-4b91-a7bc-0f50e5eb6f4a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:02 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c Jul 08 16:24:02 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:03 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" returned: 0 in 1.000s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:03 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 1G Jul 08 16:24:03 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:04 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 1G" returned: 0 in 1.259s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:04 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 Jul 08 16:24:04 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:05 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2" returned: 0 in 0.936s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:05 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 is being set with open permissions: ugo+rw Jul 08 16:24:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:05 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 Jul 08 16:24:05 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:06 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:06 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info Jul 08 16:24:06 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:07 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info" returned: 0 in 0.867s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:07 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info is being set with open permissions: ugo+rw Jul 08 16:24:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:07 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info Jul 08 16:24:07 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:08 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.info" returned: 0 in 1.130s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.197s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-63b83de9-fa1e-49bc-a1be-04902c9b13fc tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Create snapshot completed successfully Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "cinder-d4b07ca3-8a50-40ce-a3da-5583a51d80e2-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-d4b07ca3-8a50-40ce-a3da-5583a51d80e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "cinder-quobyte-d4b07ca3-8a50-40ce-a3da-5583a51d80e2" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-d4b07ca3-8a50-40ce-a3da-5583a51d80e2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Deleting offline snapshot d4b07ca3-8a50-40ce-a3da-5583a51d80e2 of volume cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] snapshot_file for this snap is: volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f436f08-e5dc-4ca3-857d-b481082a25e9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:09 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 Jul 08 16:24:09 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:10 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2" returned: 0 in 1.082s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:24:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[665df760-353a-45df-8a2a-503df3ad9da5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:10 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c Jul 08 16:24:10 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:11 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:11 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 Jul 08 16:24:11 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:12 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2" returned: 0 in 1.372s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:12 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2 Jul 08 16:24:12 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:13 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c.d4b07ca3-8a50-40ce-a3da-5583a51d80e2" returned: 0 in 0.917s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-d4b07ca3-8a50-40ce-a3da-5583a51d80e2" released by "_delete_snapshot" :: held 4.527s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" released by "delete_snapshot" :: held 4.577s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Created reservations ['adfcf078-19c4-41de-a69c-aa8978a88049', '5d81617e-f8c7-4f80-bbec-15f597e1197b', '8c8a7656-b0eb-4633-a1ce-274538cc886e', 'fcedfba6-4a07-4884-aa98-fd780f2a2dce'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:24:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Delete snapshot completed successfully. Jul 08 16:24:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63c16e1c-12e9-4621-be86-de672fb02c9d tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-d4b07ca3-8a50-40ce-a3da-5583a51d80e2-delete_snapshot" released by "delete_snapshot" :: held 4.755s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "cinder-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" acquired by "delete_volume" :: waited 0.050s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8aa7d-e1e8-498c-ab96-9bb308a41418]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:15 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c Jul 08 16:24:15 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:16 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" returned: 0 in 1.561s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:16 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c Jul 08 16:24:16 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:17 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" returned: 0 in 0.852s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-quobyte-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c" released by "delete_volume" :: held 2.550s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Created reservations ['9554474b-8922-48b5-b847-49e4a62346af', 'dacd315d-23e0-429d-b79d-d4b66c6e54eb', 'b9dc0b1a-de97-4ccf-8379-ee406df1ec78', '4ff4d155-a403-4786-b647-522effd5be24'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:17 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:24:17 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:18 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.055s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:18 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:24:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Deleted volume successfully. Jul 08 16:24:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-31b3c787-ee6e-440b-aeaa-1f493773a392 tempest-VolumeSnapshotQuotasNegativeTestJSON-920970790 None] Lock "cinder-cd1f5efd-f493-4ee6-a0c6-e12ea5599c3c-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:19 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:24:19 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:20 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.895s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:24:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:24:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:24:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Flow 'volume_create_manager' (fb7714f9-1f97-446f-b728-4de6530afc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a3dc6-2033-4955-8002-2d95cd904568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a3dc6-2033-4955-8002-2d95cd904568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1058290786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818040af-d237-4761-ac2c-072147f71b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a4a065d0e144d597e5e210a9ac9c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:27Z,use_quota=True,user_id='aa7519bdd305491ebe5728e045ea5703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7d9507-971b-44a0-b9d3-a5158dfd3405),volume_type_id=aa7d9507-971b-44a0-b9d3-a5158dfd3405)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1daa751-3d04-49b4-8a6e-b255aad8a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1daa751-3d04-49b4-8a6e-b255aad8a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54d7f28-1a4b-47cc-9168-aa03291f1c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54d7f28-1a4b-47cc-9168-aa03291f1c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818040af-d237-4761-ac2c-072147f71b00', 'volume_name': 'volume-818040af-d237-4761-ac2c-072147f71b00', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b979d14-d4c6-4730-ac8b-a808096e5ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b979d14-d4c6-4730-ac8b-a808096e5ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bdb692-c82f-4ad4-828b-ea8e0fdbe188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:26 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Volume 818040af-d237-4761-ac2c-072147f71b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818040af-d237-4761-ac2c-072147f71b00', 'volume_size': 1} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1058290786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818040af-d237-4761-ac2c-072147f71b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a4a065d0e144d597e5e210a9ac9c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:27Z,use_quota=True,user_id='aa7519bdd305491ebe5728e045ea5703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7d9507-971b-44a0-b9d3-a5158dfd3405),volume_type_id=aa7d9507-971b-44a0-b9d3-a5158dfd3405)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Creating volume 818040af-d237-4761-ac2c-072147f71b00 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:26 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:26 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 1073741824 Jul 08 16:24:26 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:27 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 1073741824" returned: 0 in 1.127s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:27 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 Jul 08 16:24:27 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:29 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00" returned: 0 in 1.172s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bdb692-c82f-4ad4-828b-ea8e0fdbe188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818040af-d237-4761-ac2c-072147f71b00', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667233bc-6cba-4026-a4f7-54f704007aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Volume volume-818040af-d237-4761-ac2c-072147f71b00 (818040af-d237-4761-ac2c-072147f71b00): created successfully Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667233bc-6cba-4026-a4f7-54f704007aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Flow 'volume_create_manager' (fb7714f9-1f97-446f-b728-4de6530afc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6a662b76-8e10-4a48-bea3-fb1e935cd1d5 tempest-VolumeTypesAccessTest-1548714758 None] Created volume successfully. Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Flow 'volume_create_manager' (5e69a364-5b9b-4629-a437-9c0973537ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40cd120-d6b0-41ed-bd24-d0dbf30933b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40cd120-d6b0-41ed-bd24-d0dbf30933b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1879241365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c492a3ab7d6d4c64b674c5ca42009b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:29Z,use_quota=True,user_id='5a4d3a5561ee4c828e9ad1ca3c9625c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa922308-c8aa-423f-b112-4cdbe7de84ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa922308-c8aa-423f-b112-4cdbe7de84ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75fe4cd-01ca-4bf7-a6ae-57a8864ddca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75fe4cd-01ca-4bf7-a6ae-57a8864ddca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105', 'volume_name': 'volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e083a5ae-2680-44ea-9959-0a66f12815d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e083a5ae-2680-44ea-9959-0a66f12815d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8a754-8c12-4967-a964-c615aed758f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Volume 4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105', 'volume_size': 1} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1879241365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c492a3ab7d6d4c64b674c5ca42009b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:29Z,use_quota=True,user_id='5a4d3a5561ee4c828e9ad1ca3c9625c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Creating volume 4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:29 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:29 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 1073741824 Jul 08 16:24:29 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Acquiring lock "cinder-818040af-d237-4761-ac2c-072147f71b00-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "cinder-818040af-d237-4761-ac2c-072147f71b00-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Acquiring lock "cinder-quobyte-818040af-d237-4761-ac2c-072147f71b00" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "cinder-quobyte-818040af-d237-4761-ac2c-072147f71b00" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943000e-e572-4534-b5fa-e76bbd54fe29]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:30 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 Jul 08 16:24:30 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:30 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 1073741824" returned: 0 in 1.012s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:30 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 Jul 08 16:24:30 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:30 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00" returned: 0 in 0.862s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:31 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00 Jul 08 16:24:31 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:31 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" returned: 0 in 0.748s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8a754-8c12-4967-a964-c615aed758f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafd5d13-849f-4644-bab0-e685418d77ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Volume volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 (4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105): created successfully Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafd5d13-849f-4644-bab0-e685418d77ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Flow 'volume_create_manager' (5e69a364-5b9b-4629-a437-9c0973537ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3908ae41-0acb-4d8f-992f-cd2eec1f6778 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Created volume successfully. Jul 08 16:24:31 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-818040af-d237-4761-ac2c-072147f71b00" returned: 0 in 0.791s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "cinder-quobyte-818040af-d237-4761-ac2c-072147f71b00" released by "delete_volume" :: held 1.698s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:31 devstack cinder-volume[87227]: WARNING cinder.quota [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1681094237 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1681094237, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:24:31 devstack cinder-volume[87227]: WARNING cinder.quota [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1681094237 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1681094237, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Created reservations ['9ae39b69-b5cf-4e8a-8532-341b31067c17', 'ba446894-6b4a-4544-bbae-ee5c17cf1258', '66f95a77-c54a-4803-9aa4-86a60577864f', 'f8b5d1f1-f196-43f8-a9d7-82694d24dfb4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:31 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:24:31 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:32 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.822s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:32 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:24:32 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Deleted volume successfully. Jul 08 16:24:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0a190a6-2ed6-47ad-a685-c60876024901 tempest-VolumeTypesAccessTest-1548714758 None] Lock "cinder-818040af-d237-4761-ac2c-072147f71b00-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[822aae7b-d930-4889-9737-73899cc21274]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:34 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 Jul 08 16:24:34 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:35 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" returned: 0 in 0.872s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e734197-c1d4-4185-85a4-b742ca7af8ba', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:24:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-e591a0d5-d013-475c-8333-60bcef269e0b req-1438e919-cb0c-4776-9ac2-300637298e82 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] attachment_update completed successfully. Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (d8762f1b-6fc7-4864-bbae-8ce7a1840be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c9622-0d78-4b3f-9bef-e4f2a5d44e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c9622-0d78-4b3f-9bef-e4f2a5d44e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1649771709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e140ff-8bc1-48d8-b837-1f60cfc38c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:37Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f839634e-3a31-40d1-a184-c582d4a2d0c4),volume_type_id=f839634e-3a31-40d1-a184-c582d4a2d0c4)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dcd264-8cd2-49c4-92e9-cf0ca5014a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dcd264-8cd2-49c4-92e9-cf0ca5014a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5547a4ec-50f8-485f-bad4-bf1ececd3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5547a4ec-50f8-485f-bad4-bf1ececd3c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e140ff-8bc1-48d8-b837-1f60cfc38c1a', 'volume_name': 'volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43abe6db-db96-447d-85c4-e168fdaa2b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43abe6db-db96-447d-85c4-e168fdaa2b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4246d0eb-a9a9-4360-8de0-bc2b5e560383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume 54e140ff-8bc1-48d8-b837-1f60cfc38c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a', 'volume_size': 1} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1649771709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e140ff-8bc1-48d8-b837-1f60cfc38c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:37Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f839634e-3a31-40d1-a184-c582d4a2d0c4),volume_type_id=f839634e-3a31-40d1-a184-c582d4a2d0c4)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Creating volume 54e140ff-8bc1-48d8-b837-1f60cfc38c1a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:37 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:37 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a 1073741824 Jul 08 16:24:37 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (ca86aaba-6836-41d1-81b0-56d04f5c1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ed56c-ac47-4d4e-b203-607fc1855661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ed56c-ac47-4d4e-b203-607fc1855661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-52539047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc10f169-4edd-4d75-8089-9ef238e7d8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:38Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d5d55e1-446b-495d-b107-f40b025a9d17),volume_type_id=4d5d55e1-446b-495d-b107-f40b025a9d17)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2136d-3642-46d6-a73e-0ecd1d0ffd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2136d-3642-46d6-a73e-0ecd1d0ffd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc182f-6d0e-449c-ac05-dd00e53d8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc182f-6d0e-449c-ac05-dd00e53d8d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc10f169-4edd-4d75-8089-9ef238e7d8e3', 'volume_name': 'volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a69084-fed0-44d2-957a-256cba9a282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a69084-fed0-44d2-957a-256cba9a282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85c91c6-ebab-452b-8c12-a31c2959efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume dc10f169-4edd-4d75-8089-9ef238e7d8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3', 'volume_size': 1} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (bbe33e09-414c-4e39-9733-e8aa7f5a9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126aa1ec-7a97-493c-b039-cb76033b33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126aa1ec-7a97-493c-b039-cb76033b33e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1472503326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d714c-0ce4-4592-b617-f77e9191437e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:39Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950aa42e-b87d-4789-85a0-8d1649b0c577),volume_type_id=950aa42e-b87d-4789-85a0-8d1649b0c577)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1712bd22-68ba-43a5-ba09-9bd6cd8c46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1712bd22-68ba-43a5-ba09-9bd6cd8c46e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5fff2-9735-405a-88bc-10ddf9eaaac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a 1073741824" returned: 0 in 1.195s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:38 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a Jul 08 16:24:38 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5fff2-9735-405a-88bc-10ddf9eaaac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '200d714c-0ce4-4592-b617-f77e9191437e', 'volume_name': 'volume-200d714c-0ce4-4592-b617-f77e9191437e', 'volume_size': 1, 'image_id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1534673552', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07e1f9ebda4f4d998e00a41135cdb962', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'created_at': datetime.datetime(2026, 7, 8, 14, 24, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 24, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b40fa-eb7a-4897-9671-7fdbfd58dbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b40fa-eb7a-4897-9671-7fdbfd58dbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2e673a-bf58-46b7-b4bf-634e63b68897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:39 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume 200d714c-0ce4-4592-b617-f77e9191437e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-200d714c-0ce4-4592-b617-f77e9191437e', 'volume_size': 1, 'image_id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1534673552', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07e1f9ebda4f4d998e00a41135cdb962', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'created_at': datetime.datetime(2026, 7, 8, 14, 24, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 24, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a/file', 'properties': {}}, 'image_service': } Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Trying to clone 200d714c-0ce4-4592-b617-f77e9191437e from image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:24:39 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" returned: 0 in 0.960s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-52539047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc10f169-4edd-4d75-8089-9ef238e7d8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:38Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d5d55e1-446b-495d-b107-f40b025a9d17),volume_type_id=4d5d55e1-446b-495d-b107-f40b025a9d17)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Creating volume dc10f169-4edd-4d75-8089-9ef238e7d8e3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:39 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4246d0eb-a9a9-4360-8de0-bc2b5e560383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:39 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 1073741824 Jul 08 16:24:39 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7956750c-ddc8-46e1-afdf-546fab6a053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:39 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a (54e140ff-8bc1-48d8-b837-1f60cfc38c1a): created successfully Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7956750c-ddc8-46e1-afdf-546fab6a053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (d8762f1b-6fc7-4864-bbae-8ce7a1840be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-818400b6-0795-4ce5-8efa-85c051f1bb9b tempest-TestInstancesWithCinderVolumes-2138098215 None] Created volume successfully. Jul 08 16:24:40 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 1073741824" returned: 0 in 1.108s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:40 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=70,cinder:INSERT=15,cinder:UPDATE=75,cinder:DELETE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:24:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:41 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 Jul 08 16:24:41 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:42 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3" returned: 0 in 1.271s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=71,cinder:SELECT=64,cinder:DELETE=9,cinder:INSERT=18 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85c91c6-ebab-452b-8c12-a31c2959efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa1f071-6a0d-44fc-bd41-28888e2fd6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 (dc10f169-4edd-4d75-8089-9ef238e7d8e3): created successfully Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa1f071-6a0d-44fc-bd41-28888e2fd6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (ca86aaba-6836-41d1-81b0-56d04f5c1350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-82a10c08-9d4a-4ad2-b7ed-2479290dab9e tempest-TestInstancesWithCinderVolumes-2138098215 None] Created volume successfully. Jul 08 16:24:44 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD, size 20.69 MB, duration 4.68 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:24:44 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Image download 20.69 MB at 4.42 MB/s Jul 08 16:24:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cca59d-ce92-4dc7-9a7a-326f2dec9a55]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:44 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD Jul 08 16:24:44 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-b518a2ca-1b73-47dd-a9fd-c03a35002252 req-f16d0b80-0862-4447-9a30-aeb956053460 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Terminate volume connection completed successfully. Jul 08 16:24:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-b518a2ca-1b73-47dd-a9fd-c03a35002252 req-f16d0b80-0862-4447-9a30-aeb956053460 tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Deleting attachment 1e734197-c1d4-4185-85a4-b742ca7af8ba. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:24:45 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD" returned: 0 in 0.897s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:45 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Temporary image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a is fetched for user 773576f946554f048ec2004d27a09a65. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:24:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef5ca11-5842-476e-ace4-5bad2ad5969b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:45 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD Jul 08 16:24:45 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:46 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1472503326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d714c-0ce4-4592-b617-f77e9191437e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e1f9ebda4f4d998e00a41135cdb962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:39Z,use_quota=True,user_id='773576f946554f048ec2004d27a09a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950aa42e-b87d-4789-85a0-8d1649b0c577),volume_type_id=950aa42e-b87d-4789-85a0-8d1649b0c577)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Creating volume 200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:46 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:46 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1073741824 Jul 08 16:24:46 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "cinder-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "cinder-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "cinder-quobyte-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "cinder-quobyte-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f566f-3cdc-4ea2-9e62-ce980fc60a82]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:47 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 Jul 08 16:24:47 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:47 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1073741824" returned: 0 in 1.204s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:47 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:24:47 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:48 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 0.841s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Attempting download of ed4c86cb-89de-4457-80d9-0f3cfdebfd2a ((None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}])) to volume 200d714c-0ce4-4592-b617-f77e9191437e. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:24:48 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" returned: 0 in 1.172s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:48 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105 Jul 08 16:24:48 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf57dea2-4362-45c8-9d40-bb9de2baae17]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:48 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3 Jul 08 16:24:48 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:49 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" returned: 0 in 0.830s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "cinder-quobyte-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105" released by "delete_volume" :: held 2.087s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Created reservations ['e063d9bb-1715-41b2-855e-056c83962da0', '573b0a60-44d3-4ce3-93b5-6b0f3577d235', 'b94a5c58-bc1c-4176-9b18-7ccec8fa3310', 'f815b4ed-d672-4372-a05e-58a20f9de9c0'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:49 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:24:49 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:49 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3" returned: 0 in 1.007s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:49 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3 Jul 08 16:24:49 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:50 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.793s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:24:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Deleted volume successfully. Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e0027530-84d9-4a1c-8674-8fb26bca8dee tempest-TestServerVolumeAttachScenarioOldVersion-1410014128 None] Lock "cinder-4a060ca1-03bf-4a8a-b4fb-5bd77fdf8105-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:24:50 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3" returned: 1 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_or84l6k3' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde08374-0f34-42fb-a94f-614b4b6b91b6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:50 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD Jul 08 16:24:50 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:51 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:51 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] ed4c86cb-89de-4457-80d9-0f3cfdebfd2a was qcow2, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:24:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:51 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:24:51 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:54 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 2.761s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed4c86cb-89de-4457-80d9-0f3cfdebfd2a_4x983ts_devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:24:54 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Converted 112.00 MB image at 40.51 MB/s Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:54 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1G Jul 08 16:24:54 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Flow 'volume_create_manager' (5b9329ea-abf0-4a8c-ba07-c70362f44f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8796f10-ef0f-479a-a3ba-b8fce5e91541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8796f10-ef0f-479a-a3ba-b8fce5e91541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1206811263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0626ca51dce4fe985bc1af43d5c8c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:55Z,use_quota=True,user_id='92136890abcf427fadbe234dbed901a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f568ef2-5091-42d7-903f-ef1b8e70d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f568ef2-5091-42d7-903f-ef1b8e70d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c313be-1a57-4417-a919-bfdcd5cb58c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:54 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c313be-1a57-4417-a919-bfdcd5cb58c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330', 'volume_name': 'volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:55 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96eada4-79ef-4e26-a94c-4053843b3c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96eada4-79ef-4e26-a94c-4053843b3c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d143fed3-3e64-483f-970d-ad8e3ab69bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Trying to clone 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e 1G" returned: 0 in 1.005s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5121c97-2b32-4554-a8a4-d1966fdf29a3]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:55 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:24:55 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:24:55 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Image download 20.69 MB at 20.69 MB/s Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a3c4af-4a17-4693-9b6d-05b3363c5d5c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:55 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD Jul 08 16:24:55 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:56 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 0.858s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:56 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:24:56 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:56 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 is fetched for user 92136890abcf427fadbe234dbed901a5. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a26f0be-3ad6-4d17-ab08-afd9e6e72506]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:56 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD Jul 08 16:24:56 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:56 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 1 in 0.805s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Downloaded image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a ((None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}])) to volume 200d714c-0ce4-4592-b617-f77e9191437e successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Temporary image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a for user 773576f946554f048ec2004d27a09a65 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Marking volume 200d714c-0ce4-4592-b617-f77e9191437e as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Copying metadata from image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a to 200d714c-0ce4-4592-b617-f77e9191437e. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Creating volume glance metadata for volume 200d714c-0ce4-4592-b617-f77e9191437e backed by image ed4c86cb-89de-4457-80d9-0f3cfdebfd2a with: {'image_id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'image_name': 'tempest-scenario-img--1534673552', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2e673a-bf58-46b7-b4bf-634e63b68897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200d714c-0ce4-4592-b617-f77e9191437e', 'volume_size': 1, 'image_id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1534673552', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07e1f9ebda4f4d998e00a41135cdb962', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed4c86cb-89de-4457-80d9-0f3cfdebfd2a', 'created_at': datetime.datetime(2026, 7, 8, 14, 24, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 24, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed4c86cb-89de-4457-80d9-0f3cfdebfd2a/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14977b-bc65-4ea8-9474-459f7363903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:24:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Volume volume-200d714c-0ce4-4592-b617-f77e9191437e (200d714c-0ce4-4592-b617-f77e9191437e): created successfully Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14977b-bc65-4ea8-9474-459f7363903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:24:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Flow 'volume_create_manager' (bbe33e09-414c-4e39-9733-e8aa7f5a9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:24:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4de79f26-11f1-45bc-a705-606db4db8044 tempest-TestInstancesWithCinderVolumes-2138098215 None] Created volume successfully. Jul 08 16:24:57 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1206811263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0626ca51dce4fe985bc1af43d5c8c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:24:55Z,use_quota=True,user_id='92136890abcf427fadbe234dbed901a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Creating volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:24:57 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:24:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:57 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1073741824 Jul 08 16:24:57 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:58 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1073741824" returned: 0 in 1.052s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:58 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:24:58 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:24:59 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 0 in 1.005s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Attempting download of c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaccf6a-ad7a-4de0-9836-715aa930923c]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:24:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:24:59 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm Jul 08 16:24:59 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:00 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm" returned: 0 in 1.368s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:01 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm Jul 08 16:25:01 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:01 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm" returned: 1 in 0.869s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_khudm6qm' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:25:01 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd14c54-dec3-413d-8b61-03274ed94476]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:01 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD Jul 08 16:25:01 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:02 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:02 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 was qcow2, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:25:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:02 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:02 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[80757541-7f93-420f-988a-64727104bba0]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:05 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:05 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:25:05 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 0 in 2.921s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_ffk9y5uwdevstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:25:05 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Converted 112.00 MB image at 38.30 MB/s Jul 08 16:25:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:05 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1G Jul 08 16:25:05 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:06 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 1.293s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:06 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 1G" returned: 0 in 1.163s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:06 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e57483-161f-47d5-95be-113bb365b33f]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:06 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:25:06 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:06 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:06 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:07 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 1 in 1.082s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.441s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:07 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 0 in 1.024s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-200d714c-0ce4-4592-b617-f77e9191437e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cb1a557-1e76-4211-858a-f2149d1c9220', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:25:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-bc30a80c-77c4-48a5-a0bf-0f4cc196bfbb req-b2872a61-c9dd-4ccb-af7b-caf052972f0a tempest-TestInstancesWithCinderVolumes-2138098215 None] attachment_update completed successfully. Jul 08 16:25:08 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:08 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:09 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 1 in 1.391s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Downloaded image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 for user 92136890abcf427fadbe234dbed901a5 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Marking volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Copying metadata from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 to 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Creating volume glance metadata for volume 8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 backed by image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d143fed3-3e64-483f-970d-ad8e3ab69bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394848cd-20b4-4329-b6f2-db6488135514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:09 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Volume volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 (8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330): created successfully Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394848cd-20b4-4329-b6f2-db6488135514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Flow 'volume_create_manager' (5b9329ea-abf0-4a8c-ba07-c70362f44f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eca78ce6-ace8-4525-b3bd-3dcc220b9803 tempest-VolumesImageMetadata-1236625082 None] Created volume successfully. Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Acquiring lock "cinder-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "cinder-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Acquiring lock "cinder-quobyte-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "cinder-quobyte-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fffc8f-cff9-4eae-b1a9-5487ff8acd7f]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:11 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:11 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:12 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 0 in 1.641s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:12 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:12 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:14 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 1 in 1.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:25:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:14 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330 Jul 08 16:25:14 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:15 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" returned: 0 in 0.794s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "cinder-quobyte-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330" released by "delete_volume" :: held 4.316s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Created reservations ['45c87553-1207-4a2f-8a3e-fa6a6211f2df', 'a9df5433-ca01-4f7c-83f1-dcda8fcb9850', '569a5f26-355d-4a6f-ac67-202e2882d399', 'fe273297-7ae7-41b6-95f8-9b138628e397'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:15 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:25:15 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:16 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:25:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Deleted volume successfully. Jul 08 16:25:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-772bc34a-a2e8-4799-bce7-11c591865d7c tempest-VolumesImageMetadata-1236625082 None] Lock "cinder-8c8d1f5e-fa4a-47b0-b61a-4e5fb00cb330-delete_volume" released by "delete_volume" :: held 5.591s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:19 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:25:19 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:21 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.925s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:25:21 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:25:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:25:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (a1ef6464-49e0-4967-9511-80001b77b502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a7dbf-1b94-43f0-bb4e-17fe5d1774a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a7dbf-1b94-43f0-bb4e-17fe5d1774a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-185521335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5449f165-4d36-447e-ab2b-3a074723d469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a9e44b4b6d4298866d0d6b0982b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:22Z,use_quota=True,user_id='e97006faf368461dbc524320f9d188c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bc3b02-d898-4de2-87db-dabebda55e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bc3b02-d898-4de2-87db-dabebda55e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c796b-d410-48d3-946d-44ffef68beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c796b-d410-48d3-946d-44ffef68beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5449f165-4d36-447e-ab2b-3a074723d469', 'volume_name': 'volume-5449f165-4d36-447e-ab2b-3a074723d469', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b03e8a-1638-4359-910d-701dfaf9ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b03e8a-1638-4359-910d-701dfaf9ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d22dfcd-59bb-4ef5-b5fb-56486748742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:22 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Volume 5449f165-4d36-447e-ab2b-3a074723d469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5449f165-4d36-447e-ab2b-3a074723d469', 'volume_size': 1} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-185521335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5449f165-4d36-447e-ab2b-3a074723d469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a9e44b4b6d4298866d0d6b0982b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:22Z,use_quota=True,user_id='e97006faf368461dbc524320f9d188c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Creating volume 5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:22 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:22 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 1073741824 Jul 08 16:25:22 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:23 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 1073741824" returned: 0 in 1.158s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:23 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 Jul 08 16:25:23 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:24 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469" returned: 0 in 0.835s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d22dfcd-59bb-4ef5-b5fb-56486748742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5449f165-4d36-447e-ab2b-3a074723d469', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aeb37da-5ff1-4f0a-8bb7-c23667c8f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Volume volume-5449f165-4d36-447e-ab2b-3a074723d469 (5449f165-4d36-447e-ab2b-3a074723d469): created successfully Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aeb37da-5ff1-4f0a-8bb7-c23667c8f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (a1ef6464-49e0-4967-9511-80001b77b502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-66baa0cf-e64b-47b8-97fb-2b43659e1923 tempest-VolumesDeleteCascade-419295721 None] Created volume successfully. Jul 08 16:25:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Creating offline snapshot 205a366d-1638-4df4-b4ed-71139c660397 of volume 5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:25:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b35ef3-1ada-4331-9f12-a27f46f72e93]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:26 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 Jul 08 16:25:26 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:27 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469" returned: 0 in 1.559s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:27 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 1G Jul 08 16:25:27 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:29 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 1G" returned: 0 in 1.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:29 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:29 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:30 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 1.262s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:30 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 is being set with open permissions: ugo+rw Jul 08 16:25:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:30 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:30 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:31 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 0.830s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:31 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info Jul 08 16:25:31 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:32 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info" returned: 0 in 0.801s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:32 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info is being set with open permissions: ugo+rw Jul 08 16:25:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:32 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info Jul 08 16:25:32 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (715e4711-15b9-419f-8257-c21fe63160b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9df4f8c-d7c7-48f6-8410-a2d0ff99e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9df4f8c-d7c7-48f6-8410-a2d0ff99e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1436686495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec35e9-3944-4068-b77b-7885a8b7be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:33Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceb2a30-8cf1-44d8-a42e-79064664267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceb2a30-8cf1-44d8-a42e-79064664267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6a058f-a8ff-4056-bc0d-910cb7b1a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6a058f-a8ff-4056-bc0d-910cb7b1a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abec35e9-3944-4068-b77b-7885a8b7be1d', 'volume_name': 'volume-abec35e9-3944-4068-b77b-7885a8b7be1d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e62975-66e3-4079-9935-f2c8c332c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e62975-66e3-4079-9935-f2c8c332c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32607a29-3784-42da-8a2a-e7cd986b51f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Volume abec35e9-3944-4068-b77b-7885a8b7be1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abec35e9-3944-4068-b77b-7885a8b7be1d', 'volume_size': 1} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:33 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.info" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.268s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1436686495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec35e9-3944-4068-b77b-7885a8b7be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:33Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Creating volume abec35e9-3944-4068-b77b-7885a8b7be1d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:33 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:33 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d 1073741824 Jul 08 16:25:33 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-48cbe30d-30eb-4443-8d48-7f3cc84184bd tempest-VolumesDeleteCascade-419295721 None] Create snapshot completed successfully Jul 08 16:25:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:34 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d 1073741824" returned: 0 in 1.209s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:34 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d Jul 08 16:25:34 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:35 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d" returned: 0 in 0.804s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.391s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32607a29-3784-42da-8a2a-e7cd986b51f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abec35e9-3944-4068-b77b-7885a8b7be1d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3e916-1416-485a-ac80-7c4285b5cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Creating offline snapshot 00279807-63ab-42d8-a8c9-4b3513f7dada of volume 5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:25:35 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Volume volume-abec35e9-3944-4068-b77b-7885a8b7be1d (abec35e9-3944-4068-b77b-7885a8b7be1d): created successfully Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3e916-1416-485a-ac80-7c4285b5cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (715e4711-15b9-419f-8257-c21fe63160b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c09d733-e0d7-4047-94f9-bcca3a86230a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e45ad329-aba9-41de-aabb-de63e97dbdf0 tempest-AttachVolumeTestJSON-144956780 None] Created volume successfully. Jul 08 16:25:35 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:35 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:36 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 0.921s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5449f165-4d36-447e-ab2b-3a074723d469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:25:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:36 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada 1G Jul 08 16:25:36 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:37 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada 1G" returned: 0 in 0.864s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:37 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada Jul 08 16:25:37 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:38 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:38 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada is being set with open permissions: ugo+rw Jul 08 16:25:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:38 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada Jul 08 16:25:38 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:38 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.376s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:38 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-92b16f49-2f97-4d57-82f0-997bb8ed247b tempest-VolumesDeleteCascade-419295721 None] Create snapshot completed successfully Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-5449f165-4d36-447e-ab2b-3a074723d469-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-5449f165-4d36-447e-ab2b-3a074723d469-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Performing cascade delete. {{(pid=87227) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-00279807-63ab-42d8-a8c9-4b3513f7dada-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-00279807-63ab-42d8-a8c9-4b3513f7dada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-00279807-63ab-42d8-a8c9-4b3513f7dada" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-00279807-63ab-42d8-a8c9-4b3513f7dada" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Deleting offline snapshot 00279807-63ab-42d8-a8c9-4b3513f7dada of volume 5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] snapshot_file for this snap is: volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b158a4c0-9d33-4a44-adce-34f286c138d4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9bd862-1501-4df8-b061-dc22b0b1fd25]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:39 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada Jul 08 16:25:39 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:39 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d Jul 08 16:25:39 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:40 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5449f165-4d36-447e-ab2b-3a074723d469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136c4f5-8365-4a8b-af22-006bba9e1573]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:40 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-abec35e9-3944-4068-b77b-7885a8b7be1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dec883e9-6d88-4920-81b5-e1fe3e56ccc3', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:25:40 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:40 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-85f07e25-d286-497b-8ef2-7f1550097304 req-2dd59941-92f7-4733-98cb-c3f6dc0404bd tempest-AttachVolumeTestJSON-144956780 None] attachment_update completed successfully. Jul 08 16:25:41 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 0.937s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5449f165-4d36-447e-ab2b-3a074723d469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:25:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:41 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada Jul 08 16:25:41 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:42 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada" returned: 0 in 1.194s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:42 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada Jul 08 16:25:42 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:43 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.00279807-63ab-42d8-a8c9-4b3513f7dada" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-00279807-63ab-42d8-a8c9-4b3513f7dada" released by "_delete_snapshot" :: held 3.855s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" released by "delete_snapshot" :: held 3.879s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=44,cinder:SELECT=52,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:DELETE=6,cinder:SELECT=50,cinder:INSERT=22,cinder:UPDATE=31 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['c9ac3f30-3b6c-40cc-aa19-7d527abef66a', 'fa13d049-8941-48aa-9ebe-002e6c1a9676', '09102217-a9a8-482c-9ac9-748376410b33', '07eb9582-9a36-45be-89fa-8053611e7eeb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:25:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Delete snapshot completed successfully. Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-00279807-63ab-42d8-a8c9-4b3513f7dada-delete_snapshot" released by "delete_snapshot" :: held 4.105s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-205a366d-1638-4df4-b4ed-71139c660397-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-205a366d-1638-4df4-b4ed-71139c660397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-205a366d-1638-4df4-b4ed-71139c660397" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-205a366d-1638-4df4-b4ed-71139c660397" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Deleting offline snapshot 205a366d-1638-4df4-b4ed-71139c660397 of volume 5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] snapshot_file for this snap is: volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e5a63-ed6b-4ed3-b963-a3f35e5fdd91]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:43 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:43 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:44 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 1.283s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5449f165-4d36-447e-ab2b-3a074723d469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d1a949-21b0-48f5-b6a9-b11ae5a0866f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:45 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 Jul 08 16:25:45 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (66f7ed46-7bc5-4076-b8a9-4537d6fa95c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49f5b67-60c4-4e2d-93f1-44fdd6be78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49f5b67-60c4-4e2d-93f1-44fdd6be78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1724938983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a61ae7-dfcc-4fc5-9e16-0cb82be9036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:46Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff450ef2-e9c1-4931-ae7d-713cb5d4c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff450ef2-e9c1-4931-ae7d-713cb5d4c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d23028-8eca-42bc-9214-16d4df278bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d23028-8eca-42bc-9214-16d4df278bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a61ae7-dfcc-4fc5-9e16-0cb82be9036b', 'volume_name': 'volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f2a0a-126c-4e53-a910-567f4b4d620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f2a0a-126c-4e53-a910-567f4b4d620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7549a4c1-b2b4-4dc3-a526-b84b3eb28d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Volume 22a61ae7-dfcc-4fc5-9e16-0cb82be9036b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b', 'volume_size': 1} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1724938983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a61ae7-dfcc-4fc5-9e16-0cb82be9036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fed7cca21a4e1da44489291de2f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:46Z,use_quota=True,user_id='64cc93731e0a49c494e5faf0ee3346e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Creating volume 22a61ae7-dfcc-4fc5-9e16-0cb82be9036b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:45 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:45 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b 1073741824 Jul 08 16:25:45 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:45 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469" returned: 0 in 0.935s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:46 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:46 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:46 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b 1073741824" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:46 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b Jul 08 16:25:46 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:46 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:46 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397 Jul 08 16:25:46 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:47 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469.205a366d-1638-4df4-b4ed-71139c660397" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:47 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-205a366d-1638-4df4-b4ed-71139c660397" released by "_delete_snapshot" :: held 4.077s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" released by "delete_snapshot" :: held 4.108s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7549a4c1-b2b4-4dc3-a526-b84b3eb28d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a6905f-300d-4a31-81cc-13dcd7f22fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Volume volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b (22a61ae7-dfcc-4fc5-9e16-0cb82be9036b): created successfully Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a6905f-300d-4a31-81cc-13dcd7f22fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Flow 'volume_create_manager' (66f7ed46-7bc5-4076-b8a9-4537d6fa95c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a6e6875b-008a-41d9-93da-e09dd3d6abeb tempest-AttachVolumeTestJSON-144956780 None] Created volume successfully. Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['0e5aeaf9-a301-4066-a402-455a736da370', '6864885c-d69c-4f5e-a9e7-1eba62990788', '5601cf31-b026-48a9-90d5-7af0653ff069', 'bede7b81-63bb-48b9-88a8-6dc298e85204'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:25:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Delete snapshot completed successfully. Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-205a366d-1638-4df4-b4ed-71139c660397-delete_snapshot" released by "delete_snapshot" :: held 4.366s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Snapshots deleted, issuing volume delete {{(pid=87227) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:25:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e933d9c-79a3-49a5-842e-422e29d37e8a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:48 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 Jul 08 16:25:48 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Flow 'volume_create_manager' (03733246-b2bc-4cf9-9e9a-8f5ff6a4c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5a93db-4e5d-4007-b32b-05ba8ea22596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5a93db-4e5d-4007-b32b-05ba8ea22596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-592886403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c8a1b8-ffce-4444-9f2a-453d1eaabf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5797a09570c47e2ab32ed6d2dcf7aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:48Z,use_quota=True,user_id='666443376ac3448cb4d784033579d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011530ac-3d0d-4c6e-aef2-aee78efe9efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011530ac-3d0d-4c6e-aef2-aee78efe9efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e950ee-14e6-432c-a42c-226c087a53a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e950ee-14e6-432c-a42c-226c087a53a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c8a1b8-ffce-4444-9f2a-453d1eaabf72', 'volume_name': 'volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ace147-9cc2-4ca3-9c30-bc36e6a0358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ace147-9cc2-4ca3-9c30-bc36e6a0358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f62203-9ea1-42d2-a9e3-fb51e98d9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:48 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume 53c8a1b8-ffce-4444-9f2a-453d1eaabf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72', 'volume_size': 1} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-592886403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c8a1b8-ffce-4444-9f2a-453d1eaabf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5797a09570c47e2ab32ed6d2dcf7aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:48Z,use_quota=True,user_id='666443376ac3448cb4d784033579d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Creating volume 53c8a1b8-ffce-4444-9f2a-453d1eaabf72 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:48 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:48 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 1073741824 Jul 08 16:25:48 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Flow 'volume_create_manager' (39653e0d-0c01-44ea-8b4a-690f54deae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b77997b-6e1d-4355-af1e-c4961302de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:49 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469" returned: 0 in 1.027s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:49 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469 Jul 08 16:25:49 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b77997b-6e1d-4355-af1e-c4961302de72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1317055088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7212778f-90f5-4e64-b7e3-8f1beab31552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5797a09570c47e2ab32ed6d2dcf7aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:49Z,use_quota=True,user_id='666443376ac3448cb4d784033579d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5368c55d-d7a9-4207-b8a5-37ba1f736eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5368c55d-d7a9-4207-b8a5-37ba1f736eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388012cb-f585-4a6b-882e-9df7435dcb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388012cb-f585-4a6b-882e-9df7435dcb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7212778f-90f5-4e64-b7e3-8f1beab31552', 'volume_name': 'volume-7212778f-90f5-4e64-b7e3-8f1beab31552', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdebb82-aeed-400d-a841-0e660e913500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdebb82-aeed-400d-a841-0e660e913500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2049c1-b38e-483d-a4e8-ffceceb1758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume 7212778f-90f5-4e64-b7e3-8f1beab31552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7212778f-90f5-4e64-b7e3-8f1beab31552', 'volume_size': 1} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:49 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 1073741824" returned: 0 in 1.146s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:49 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5449f165-4d36-447e-ab2b-3a074723d469" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:49 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 Jul 08 16:25:49 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-5449f165-4d36-447e-ab2b-3a074723d469" released by "delete_volume" :: held 1.917s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:49 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['2aaaea32-9ce1-4531-b066-4d2178016ef2', '2ce18856-a86a-4d4b-98c0-482d076fe480', '02b72b96-4cca-4239-8909-50fc3f82979b', 'cd6982c5-8d76-49a8-8117-254f3d419411'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:50 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:25:50 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:50 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" returned: 0 in 0.803s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1317055088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7212778f-90f5-4e64-b7e3-8f1beab31552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5797a09570c47e2ab32ed6d2dcf7aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:49Z,use_quota=True,user_id='666443376ac3448cb4d784033579d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Creating volume 7212778f-90f5-4e64-b7e3-8f1beab31552 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:50 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:50 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 1073741824 Jul 08 16:25:50 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f62203-9ea1-42d2-a9e3-fb51e98d9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82106856-bf6f-445a-9b53-6c98eb68ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 (53c8a1b8-ffce-4444-9f2a-453d1eaabf72): created successfully Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82106856-bf6f-445a-9b53-6c98eb68ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Flow 'volume_create_manager' (03733246-b2bc-4cf9-9e9a-8f5ff6a4c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4081406a-669c-4f1b-ae16-917069887b95 tempest-TestServerVolumeAttachmentScenario-844736232 None] Created volume successfully. Jul 08 16:25:50 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.857s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:25:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Deleted volume successfully. Jul 08 16:25:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-35b19949-e0dd-4cf4-9a57-eb0dc6618ac3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-5449f165-4d36-447e-ab2b-3a074723d469-delete_volume" released by "delete_volume" :: held 11.562s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (d97b8a41-bbe8-4222-ada5-d0968c61a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046305d6-b357-4f0b-8a89-7125f94d7656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046305d6-b357-4f0b-8a89-7125f94d7656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-126468573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabe2489-c1c9-4e01-b0a6-7ddc61afa2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a9e44b4b6d4298866d0d6b0982b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:51Z,use_quota=True,user_id='e97006faf368461dbc524320f9d188c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a891dd-10c7-4de1-af81-712423eb3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a891dd-10c7-4de1-af81-712423eb3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410fb5ca-f87a-4a90-8105-d26c00aa8070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410fb5ca-f87a-4a90-8105-d26c00aa8070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabe2489-c1c9-4e01-b0a6-7ddc61afa2db', 'volume_name': 'volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e4d80-d99b-46b4-80ab-d57ebde825e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e4d80-d99b-46b4-80ab-d57ebde825e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2723dc2-64f6-4743-9c09-63d4d8651a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Volume dabe2489-c1c9-4e01-b0a6-7ddc61afa2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db', 'volume_size': 1} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:51 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 1073741824" returned: 0 in 1.168s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:51 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 Jul 08 16:25:51 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:52 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-126468573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabe2489-c1c9-4e01-b0a6-7ddc61afa2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a9e44b4b6d4298866d0d6b0982b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:25:51Z,use_quota=True,user_id='e97006faf368461dbc524320f9d188c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Creating volume dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:25:52 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2049c1-b38e-483d-a4e8-ffceceb1758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7212778f-90f5-4e64-b7e3-8f1beab31552', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c437c5-db4b-42ce-a34b-4e02d11ce36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:52 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db 1073741824 Jul 08 16:25:52 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Volume volume-7212778f-90f5-4e64-b7e3-8f1beab31552 (7212778f-90f5-4e64-b7e3-8f1beab31552): created successfully Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c437c5-db4b-42ce-a34b-4e02d11ce36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Flow 'volume_create_manager' (39653e0d-0c01-44ea-8b4a-690f54deae82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bd4a3034-822e-4169-9ed3-3e20258bf935 tempest-TestServerVolumeAttachmentScenario-844736232 None] Created volume successfully. Jul 08 16:25:53 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db 1073741824" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:53 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:25:53 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:54 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.660s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.231s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2723dc2-64f6-4743-9c09-63d4d8651a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202f63fd-580a-4429-80f1-23c5033816db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e195940-0114-4b1f-81d1-963d484466e4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Volume volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db (dabe2489-c1c9-4e01-b0a6-7ddc61afa2db): created successfully Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202f63fd-580a-4429-80f1-23c5033816db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:25:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (d97b8a41-bbe8-4222-ada5-d0968c61a75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:25:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f977d696-a698-4100-947b-e12e793f0f2e tempest-VolumesDeleteCascade-419295721 None] Created volume successfully. Jul 08 16:25:54 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a Jul 08 16:25:54 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:55 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.700s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff8330-6bf2-4bef-8e0d-4ac36461ef30]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cef3a85d-6549-43c7-8647-f6735053333d', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:25:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-3e8279ba-c78a-4b6a-a732-a5e50f0406dd req-84ef8e0e-e0f5-4ece-9fd0-6b173dbcdf72 tempest-TestInstancesWithCinderVolumes-2138098215 None] attachment_update completed successfully. Jul 08 16:25:55 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b Jul 08 16:25:55 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:25:55 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" returned: 0 in 0.866s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Creating offline snapshot 6f8320b2-173c-4f5a-8989-d39bad40ab13 of volume dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d59cc-7d89-495e-bbb6-490b8200996d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e8c3721-923b-4f8d-9558-aaa0df48a6ac', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:25:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-67e6489a-eeb2-4021-91cd-dfc080d0774d req-863f00db-df87-42d8-92db-375cb19fdd33 tempest-AttachVolumeTestJSON-144956780 None] attachment_update completed successfully. Jul 08 16:25:56 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:25:56 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:56 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:56 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 1G Jul 08 16:25:56 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:57 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 1G" returned: 0 in 0.953s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:57 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:25:57 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:58 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:58 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 is being set with open permissions: ugo+rw Jul 08 16:25:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:58 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:25:58 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:25:59 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 08 16:25:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:25:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:25:59 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info Jul 08 16:25:59 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:00 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info" returned: 0 in 0.717s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:00 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info is being set with open permissions: ugo+rw Jul 08 16:26:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:00 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info Jul 08 16:26:00 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:00 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.info" returned: 0 in 0.754s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2071d581-f0f1-4ed1-bd07-bddd24fae4a1 tempest-VolumesDeleteCascade-419295721 None] Create snapshot completed successfully Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (f536ab63-2f07-455a-9d46-cbe4d954dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfec09a5-930f-449c-a3c1-32902cb68dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfec09a5-930f-449c-a3c1-32902cb68dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-429702257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd69eca6-4f90-4dbf-b2ca-461f62d8ea17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a9e44b4b6d4298866d0d6b0982b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f8320b2-173c-4f5a-8989-d39bad40ab13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:02Z,use_quota=True,user_id='e97006faf368461dbc524320f9d188c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0beeee6-6c4c-4ca2-89e0-2af8da4df549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0beeee6-6c4c-4ca2-89e0-2af8da4df549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3e143d-7d9f-412e-b42e-38c2be4acd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3e143d-7d9f-412e-b42e-38c2be4acd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd69eca6-4f90-4dbf-b2ca-461f62d8ea17', 'volume_name': 'volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17', 'volume_size': 1, 'snapshot_id': '6f8320b2-173c-4f5a-8989-d39bad40ab13'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda409f-9968-485b-8746-b06e2dfb4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda409f-9968-485b-8746-b06e2dfb4763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437d29fb-70ce-4ebf-bfc7-eef5af6653db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Volume fd69eca6-4f90-4dbf-b2ca-461f62d8ea17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17', 'volume_size': 1, 'snapshot_id': '6f8320b2-173c-4f5a-8989-d39bad40ab13'} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Creating volume fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 from snapshot 6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] snapshot: 6f8320b2-173c-4f5a-8989-d39bad40ab13, volume: fd69eca6-4f90-4dbf-b2ca-461f62d8ea17, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b95d7-7c2d-4a9a-9cca-45ca944ad352]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:01 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:26:01 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-a6519f27-c77d-4f4c-8283-b9501d1b029c req-cda38176-f125-4949-be0b-f4995c5c007b tempest-AttachVolumeTestJSON-144956780 None] Terminate volume connection completed successfully. Jul 08 16:26:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-a6519f27-c77d-4f4c-8283-b9501d1b029c req-cda38176-f125-4949-be0b-f4995c5c007b tempest-AttachVolumeTestJSON-144956780 None] Deleting attachment dec883e9-6d88-4920-81b5-e1fe3e56ccc3. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:03 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 1.220s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae455ca1-3dc4-4874-bb8b-c4a83c89393e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:03 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:26:03 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:04 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.934s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:04 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:26:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:04 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 Jul 08 16:26:04 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-df26a0a8-6f17-493e-b44e-f33c6a349ec9 req-10a92754-a2f5-4277-aade-bdac5157ed1b tempest-AttachVolumeTestJSON-144956780 None] Terminate volume connection completed successfully. Jul 08 16:26:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-df26a0a8-6f17-493e-b44e-f33c6a349ec9 req-10a92754-a2f5-4277-aade-bdac5157ed1b tempest-AttachVolumeTestJSON-144956780 None] Deleting attachment 3e8c3721-923b-4f8d-9558-aaa0df48a6ac. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:12 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" returned: 0 in 8.101s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0825074-5287-4551-986c-8a73e5203ad0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:12 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:26:12 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:13 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 1.544s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:13 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:26:13 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Converted 1024.00 MB image at 126.37 MB/s Jul 08 16:26:13 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 is being set with open permissions: ugo+rw Jul 08 16:26:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:13 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 Jul 08 16:26:13 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:13 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=8,cinder:UPDATE=37,cinder:SELECT=39,cinder:DELETE=2 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:26:14 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" returned: 0 in 0.716s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" released by "_copy_volume_from_snapshot" :: held 12.677s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" released by "_create_volume_from_snapshot" :: held 12.712s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.732s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.495s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc97619-5482-404f-ae83-bd0a1e4c1f6c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437d29fb-70ce-4ebf-bfc7-eef5af6653db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17', 'volume_size': 1, 'snapshot_id': '6f8320b2-173c-4f5a-8989-d39bad40ab13'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4975d552-1ac9-4c84-912a-518232f5d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:14 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Volume volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 (fd69eca6-4f90-4dbf-b2ca-461f62d8ea17): created successfully Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4975d552-1ac9-4c84-912a-518232f5d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Flow 'volume_create_manager' (f536ab63-2f07-455a-9d46-cbe4d954dd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-12916251-f086-43b0-ac5e-9be4df74aedb tempest-VolumesDeleteCascade-419295721 None] Created volume successfully. Jul 08 16:26:14 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 Jul 08 16:26:14 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Performing cascade delete. {{(pid=87227) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-6f8320b2-173c-4f5a-8989-d39bad40ab13-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-6f8320b2-173c-4f5a-8989-d39bad40ab13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Deleting offline snapshot 6f8320b2-173c-4f5a-8989-d39bad40ab13 of volume dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] snapshot_file for this snap is: volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[59192874-5548-44ba-bd54-604c1d68cdd3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:15 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:26:15 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:15 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3" returned: 0 in 0.923s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5918c980-38fc-4255-9455-c7359e6b79e5', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:26:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-0b52f3a2-a7e1-45e2-a0c5-c0d50ac40cf5 req-501c797d-7f9d-4a89-aa2f-c446fabd1fee tempest-TestInstancesWithCinderVolumes-2138098215 None] attachment_update completed successfully. Jul 08 16:26:16 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 0.885s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[82945ea5-54a7-4aca-879f-a29178c76df8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:16 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:26:16 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:16 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.769s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:16 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:26:16 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:17 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 0.869s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:17 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13 Jul 08 16:26:17 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:18 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db.6f8320b2-173c-4f5a-8989-d39bad40ab13" returned: 0 in 0.667s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-6f8320b2-173c-4f5a-8989-d39bad40ab13" released by "_delete_snapshot" :: held 3.291s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" released by "delete_snapshot" :: held 3.317s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['346b913b-1735-49c9-842a-92019322f134', 'cee08e1c-d710-4025-9e62-ebf74c99d1cd', '0006ac0c-cbdd-4ddf-bdef-b85ab8b15977', '85f8b7e0-b8b7-469f-8af4-b529f1833418'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Delete snapshot completed successfully. Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-6f8320b2-173c-4f5a-8989-d39bad40ab13-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Snapshots deleted, issuing volume delete {{(pid=87227) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead2016-575a-4753-abaf-f1c9f3a3ae0f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:18 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:26:18 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-quobyte-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f830277-1264-4e5f-99a9-c1ff7827b10f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:19 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:19 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:19 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b Jul 08 16:26:19 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:19 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:19 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db Jul 08 16:26:19 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:20 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:26:20 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:20 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" returned: 0 in 0.701s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:20 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b Jul 08 16:26:20 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db" released by "delete_volume" :: held 1.579s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['074a596c-70e9-4db3-af1c-20e4d9045d03', 'd9b6754e-a90f-400b-af2b-3073a2804565', '3af2433c-becd-4771-8853-a86bd863157f', 'fb0168bc-65e8-4565-a142-b68eb4b68f1a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:20 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:20 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f4602-650f-41b6-ace9-f6ff8ccf67e0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:20 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 Jul 08 16:26:20 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:20 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" returned: 0 in 0.821s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b" released by "delete_volume" :: held 1.710s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Created reservations ['578d50b9-156b-4f7e-ab75-659e242713b2', '11d40262-4f8d-46b4-b389-b075776bd5dd', '79f6216c-f5f3-446d-99a9-6a3e86fabf41', '27a4861f-1c69-4c54-b491-9807cd5119ab'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:21 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:21 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:21 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.841s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Deleted volume successfully. Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9b654221-448c-47de-9780-d74b8d843d90 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-dabe2489-c1c9-4e01-b0a6-7ddc61afa2db-delete_volume" released by "delete_volume" :: held 6.222s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-abec35e9-3944-4068-b77b-7885a8b7be1d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-abec35e9-3944-4068-b77b-7885a8b7be1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-quobyte-abec35e9-3944-4068-b77b-7885a8b7be1d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-abec35e9-3944-4068-b77b-7885a8b7be1d" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a2b76-0788-4d10-94fb-15483eda2d42]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:21 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" returned: 0 in 0.910s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:21 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17 Jul 08 16:26:21 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:21 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d Jul 08 16:26:21 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:21 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.814s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Deleted volume successfully. Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-971ff7a6-cea1-4182-94b4-f561a0ef2559 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-22a61ae7-dfcc-4fc5-9e16-0cb82be9036b-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:22 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-quobyte-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17" released by "delete_volume" :: held 1.729s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:22 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d" returned: 0 in 0.890s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:22 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d Jul 08 16:26:22 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Created reservations ['6379fa1f-e5e6-4e2f-965e-f8f65c861e9a', '4825d464-d1f8-4930-8e58-6ba2d3ba6f64', 'e1772896-95f3-4814-89a6-a249ac27dc5a', '2574e9a7-4854-4d75-a2a5-c2902e0f2850'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:22 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:22 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:23 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-abec35e9-3944-4068-b77b-7885a8b7be1d" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-abec35e9-3944-4068-b77b-7885a8b7be1d" released by "delete_volume" :: held 1.709s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Created reservations ['a70a11b7-57dd-4b9d-bd0d-b39bdee17435', '55450d58-9c62-43b7-b843-e8aefd41641c', '7c1fd983-9c18-4dbf-b2bd-0c26942100c1', '471a0f2a-5116-4de7-9166-ae78d8d24133'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:23 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.757s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Deleted volume successfully. Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-91469cb6-4f5a-47ea-8e29-24e71a0d41f3 tempest-VolumesDeleteCascade-419295721 None] Lock "cinder-fd69eca6-4f90-4dbf-b2ca-461f62d8ea17-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:23 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:23 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-9fe5eab2-aed0-4865-9d37-5a35bb21f39b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-9fe5eab2-aed0-4865-9d37-5a35bb21f39b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "cinder-quobyte-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[762badd9-e2eb-49f8-af86-19724a3df62a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:24 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b Jul 08 16:26:24 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:24 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.817s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Deleted volume successfully. Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-85dec7b3-3f24-41f0-810e-603398f1c5aa tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-abec35e9-3944-4068-b77b-7885a8b7be1d-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:24 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:24 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b Jul 08 16:26:24 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-0cc528b3-a7d8-45be-bb06-ebb0cc4bec69 req-eb01303d-1bbe-4744-8cac-bdb9889c661d tempest-TestInstancesWithCinderVolumes-2138098215 None] Terminate volume connection completed successfully. Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-0cc528b3-a7d8-45be-bb06-ebb0cc4bec69 req-eb01303d-1bbe-4744-8cac-bdb9889c661d tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleting attachment cef3a85d-6549-43c7-8647-f6735053333d. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:25 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" returned: 0 in 0.835s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-quobyte-9fe5eab2-aed0-4865-9d37-5a35bb21f39b" released by "delete_volume" :: held 1.734s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Created reservations ['9a04c309-6304-4bc6-82ae-078d2f79fea7', '89b183c9-e712-401b-ba50-1d677ff7d006', '258865f7-32cf-48b4-ae7c-b3679f47b7ea', '6df4898a-81ac-4eed-8e8a-56acf5f2bf34'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:25 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:25 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:26 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.833s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:26 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:26 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Deleted volume successfully. Jul 08 16:26:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca967b32-922f-458e-bd70-deeebe738645 tempest-AttachVolumeTestJSON-144956780 None] Lock "cinder-9fe5eab2-aed0-4865-9d37-5a35bb21f39b-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-54e140ff-8bc1-48d8-b837-1f60cfc38c1a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-54e140ff-8bc1-48d8-b837-1f60cfc38c1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-quobyte-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad120d6-89a2-4d8d-a600-40f3517e34c6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:27 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a Jul 08 16:26:27 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Flow 'volume_create_manager' (3f75a332-b5c9-4e14-9d9f-ec8325ff93c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b10da67-5848-484d-8df2-5cad81233956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b10da67-5848-484d-8df2-5cad81233956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1785087533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa22e1b-4a83-453b-bd26-b0716a755a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02317dc8dbbc4d2cbf7be28018c90386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:29Z,use_quota=True,user_id='63d67b05802c4054a45a50f08d2739b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3862d6-368c-4083-be6d-575b2e8e5505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3862d6-368c-4083-be6d-575b2e8e5505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b528e6-b895-4488-8d61-5e65a7a1e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b528e6-b895-4488-8d61-5e65a7a1e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa22e1b-4a83-453b-bd26-b0716a755a92', 'volume_name': 'volume-9aa22e1b-4a83-453b-bd26-b0716a755a92', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac24c932-a7bb-4a9d-95ad-4280a7b815a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac24c932-a7bb-4a9d-95ad-4280a7b815a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a269edd-950e-4e89-9d76-a60e12e082fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:28 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Volume 9aa22e1b-4a83-453b-bd26-b0716a755a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa22e1b-4a83-453b-bd26-b0716a755a92', 'volume_size': 1} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1785087533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa22e1b-4a83-453b-bd26-b0716a755a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02317dc8dbbc4d2cbf7be28018c90386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:29Z,use_quota=True,user_id='63d67b05802c4054a45a50f08d2739b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Creating volume 9aa22e1b-4a83-453b-bd26-b0716a755a92 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:26:28 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:26:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:28 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 1073741824 Jul 08 16:26:28 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:28 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" returned: 0 in 1.176s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:29 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a Jul 08 16:26:29 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:29 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 1073741824" returned: 0 in 1.124s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:29 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-54e140ff-8bc1-48d8-b837-1f60cfc38c1a" released by "delete_volume" :: held 2.140s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:29 devstack cinder-volume[87227]: WARNING cinder.quota [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-10547362-2028288176 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-10547362-2028288176, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:29 devstack cinder-volume[87227]: WARNING cinder.quota [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-10547362-2028288176 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-10547362-2028288176, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:29 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 Jul 08 16:26:29 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Created reservations ['eac6dd09-baed-4d8e-9c3d-284f920ac87f', 'e5882f92-8a5c-4bb5-ad50-53e0aa2bc303', '65cc987a-8efb-4a3f-8863-44b49a4eda34', '8107ba51-8db4-4703-a9fa-7785d673416b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:30 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:30 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:31 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:31 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92" returned: 0 in 1.079s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.842s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleted volume successfully. Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a269edd-950e-4e89-9d76-a60e12e082fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa22e1b-4a83-453b-bd26-b0716a755a92', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea28f453-095f-4db9-a661-18330b92bf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-270253d9-9393-41b4-a7ea-c333a258cacf tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-54e140ff-8bc1-48d8-b837-1f60cfc38c1a-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Volume volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 (9aa22e1b-4a83-453b-bd26-b0716a755a92): created successfully Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea28f453-095f-4db9-a661-18330b92bf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Flow 'volume_create_manager' (3f75a332-b5c9-4e14-9d9f-ec8325ff93c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-39d362ad-264c-4258-84a7-05f639655380 tempest-VolumesTransfersTest-402849514 None] Created volume successfully. Jul 08 16:26:32 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-88a3e7b6-c41d-4e38-89e8-e16b1bc4895f tempest-VolumesTransfersTest-1433793849 None] Transfer volume completed successfully. Jul 08 16:26:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-0c84117d-9d6c-433b-b051-686dfda229d6 req-4cd5f4cd-7a07-4a59-8af2-25642e0010f4 tempest-TestInstancesWithCinderVolumes-2138098215 None] Terminate volume connection completed successfully. Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-0c84117d-9d6c-433b-b051-686dfda229d6 req-4cd5f4cd-7a07-4a59-8af2-25642e0010f4 tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleting attachment 5918c980-38fc-4255-9455-c7359e6b79e5. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Acquiring lock "cinder-9aa22e1b-4a83-453b-bd26-b0716a755a92-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "cinder-9aa22e1b-4a83-453b-bd26-b0716a755a92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Acquiring lock "cinder-quobyte-9aa22e1b-4a83-453b-bd26-b0716a755a92" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "cinder-quobyte-9aa22e1b-4a83-453b-bd26-b0716a755a92" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[59524e6d-856c-4432-9d09-cc020c59740f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:34 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 Jul 08 16:26:34 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:34 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:34 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92 Jul 08 16:26:34 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Flow 'volume_create_manager' (ad18451b-70a7-4306-b096-7ca8b8ac3b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c288e12c-06f2-47d4-a86b-1b74c3edf3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-dc10f169-4edd-4d75-8089-9ef238e7d8e3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c288e12c-06f2-47d4-a86b-1b74c3edf3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1263038363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad69491a-f71a-40f2-9328-62efd03c9a1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb343bb4a67849d19beb60b89fba0bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:35Z,use_quota=True,user_id='ccb6c948f6f1497289101833140de069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae041f2-9b16-4de8-b452-a78090d7c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae041f2-9b16-4de8-b452-a78090d7c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2b6520-89a9-461d-ab6c-24ad50a118d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2b6520-89a9-461d-ab6c-24ad50a118d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad69491a-f71a-40f2-9328-62efd03c9a1c', 'volume_name': 'volume-ad69491a-f71a-40f2-9328-62efd03c9a1c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd89b25-2c30-4feb-8a1a-482df724c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd89b25-2c30-4feb-8a1a-482df724c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8759cd0f-2ebb-420b-9136-da3199dd6e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Volume ad69491a-f71a-40f2-9328-62efd03c9a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad69491a-f71a-40f2-9328-62efd03c9a1c', 'volume_size': 1} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1263038363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad69491a-f71a-40f2-9328-62efd03c9a1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb343bb4a67849d19beb60b89fba0bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:35Z,use_quota=True,user_id='ccb6c948f6f1497289101833140de069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Creating volume ad69491a-f71a-40f2-9328-62efd03c9a1c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:26:34 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-dc10f169-4edd-4d75-8089-9ef238e7d8e3-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:34 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c 1073741824 Jul 08 16:26:34 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-quobyte-dc10f169-4edd-4d75-8089-9ef238e7d8e3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-dc10f169-4edd-4d75-8089-9ef238e7d8e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac067983-2873-4e6f-8690-d46a50c3203c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:35 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 Jul 08 16:26:35 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:35 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9aa22e1b-4a83-453b-bd26-b0716a755a92" returned: 0 in 0.785s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "cinder-quobyte-9aa22e1b-4a83-453b-bd26-b0716a755a92" released by "delete_volume" :: held 1.654s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Created reservations ['790cd5b3-ec7f-4e96-88af-cd63abc4faa9', 'b763d87a-3163-4bdf-b288-4ae1b08761fd', '51f14914-7438-492b-996f-432b10ac79b6', 'c4afd116-e48d-4779-b2c8-ade70c705755'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:35 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:35 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:35 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:35 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c 1073741824" returned: 0 in 1.129s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3" returned: 0 in 0.974s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:36 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3 Jul 08 16:26:36 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:36 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c Jul 08 16:26:36 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:36 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.092s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:36 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:36 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Deleted volume successfully. Jul 08 16:26:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-16c1b018-a791-4aa5-bc41-42d827949180 tempest-VolumesTransfersTest-144193860 None] Lock "cinder-9aa22e1b-4a83-453b-bd26-b0716a755a92-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:37 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c" returned: 0 in 0.953s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.361s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8759cd0f-2ebb-420b-9136-da3199dd6e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad69491a-f71a-40f2-9328-62efd03c9a1c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b018f5-2c1c-4bff-bc15-6754b8480265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada9e80-8e6c-4597-9797-14d93dcda44b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Volume volume-ad69491a-f71a-40f2-9328-62efd03c9a1c (ad69491a-f71a-40f2-9328-62efd03c9a1c): created successfully Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b018f5-2c1c-4bff-bc15-6754b8480265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Flow 'volume_create_manager' (ad18451b-70a7-4306-b096-7ca8b8ac3b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dc10f169-4edd-4d75-8089-9ef238e7d8e3" returned: 0 in 1.217s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Flow 'volume_create_manager' (8179e9f2-3faa-47f2-af41-3c9be9964941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46fc056-a7a2-4f74-a8c4-da3c5b8a8601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-dc10f169-4edd-4d75-8089-9ef238e7d8e3" released by "delete_volume" :: held 2.313s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:37 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 Jul 08 16:26:37 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-5c10cf30-075f-4a65-8332-b3f79fd5761e req-cdbd567c-686c-46aa-87c8-23189081cd24 tempest-VolumesGetTestJSON-938644407 None] Created volume successfully. Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46fc056-a7a2-4f74-a8c4-da3c5b8a8601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1494251655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce66692-61b5-4fb3-9411-ef2e4688a00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02317dc8dbbc4d2cbf7be28018c90386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:37Z,use_quota=True,user_id='63d67b05802c4054a45a50f08d2739b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529721ed-87b2-4612-8ac0-dbd3ead7a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529721ed-87b2-4612-8ac0-dbd3ead7a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575350fa-1b22-459e-ad90-687053c9bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575350fa-1b22-459e-ad90-687053c9bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce66692-61b5-4fb3-9411-ef2e4688a00d', 'volume_name': 'volume-cce66692-61b5-4fb3-9411-ef2e4688a00d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad749b1-aa16-402a-b4b8-3fd5ea98de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad749b1-aa16-402a-b4b8-3fd5ea98de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36d5d68-6ad0-451f-b223-aed2999440f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Volume cce66692-61b5-4fb3-9411-ef2e4688a00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce66692-61b5-4fb3-9411-ef2e4688a00d', 'volume_size': 1} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:37 devstack cinder-volume[87227]: WARNING cinder.quota [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400531754-1845095074 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400531754-1845095074, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:37 devstack cinder-volume[87227]: WARNING cinder.quota [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400531754-1845095074 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400531754-1845095074, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Created reservations ['b7851f65-c223-4b80-bb6c-a7d9091839f3', '34bb0f9a-6a7a-4489-8938-97b82e3ccf33', '51574762-0cb3-4625-a614-99dad668d644', '2317985f-8b49-4795-8555-eff9c36d0c83'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:37 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:37 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:38 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" returned: 0 in 1.004s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1494251655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce66692-61b5-4fb3-9411-ef2e4688a00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02317dc8dbbc4d2cbf7be28018c90386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:37Z,use_quota=True,user_id='63d67b05802c4054a45a50f08d2739b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Creating volume cce66692-61b5-4fb3-9411-ef2e4688a00d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:26:38 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:38 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d 1073741824 Jul 08 16:26:38 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd381dcf-0bed-4aec-81fb-e10e7954c2a4', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:26:38 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-848d0b39-e89a-4449-a087-5984b452ae11 req-a8cd36fa-0423-4fcf-a4a2-9696bed3c409 tempest-TestServerVolumeAttachmentScenario-844736232 None] attachment_update completed successfully. Jul 08 16:26:38 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.874s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:38 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleted volume successfully. Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0d3e3515-c160-49c0-94c6-18cabca5fed6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-dc10f169-4edd-4d75-8089-9ef238e7d8e3-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Acquiring lock "cinder-ad69491a-f71a-40f2-9328-62efd03c9a1c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "cinder-ad69491a-f71a-40f2-9328-62efd03c9a1c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Acquiring lock "cinder-quobyte-ad69491a-f71a-40f2-9328-62efd03c9a1c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "cinder-quobyte-ad69491a-f71a-40f2-9328-62efd03c9a1c" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750cfc8-e1da-4f09-963e-821fd03f4966]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:38 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c Jul 08 16:26:38 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:39 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d 1073741824" returned: 0 in 1.134s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:39 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d Jul 08 16:26:39 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:39 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c" returned: 0 in 0.890s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:39 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c Jul 08 16:26:39 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:40 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d" returned: 0 in 0.751s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36d5d68-6ad0-451f-b223-aed2999440f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce66692-61b5-4fb3-9411-ef2e4688a00d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4c8b13-2ec5-4ce4-b200-d20c6d164511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:40 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Volume volume-cce66692-61b5-4fb3-9411-ef2e4688a00d (cce66692-61b5-4fb3-9411-ef2e4688a00d): created successfully Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4c8b13-2ec5-4ce4-b200-d20c6d164511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Flow 'volume_create_manager' (8179e9f2-3faa-47f2-af41-3c9be9964941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7486c086-4aa6-4574-ac6e-b28dfdc9165d tempest-VolumesTransfersTest-402849514 None] Created volume successfully. Jul 08 16:26:40 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ad69491a-f71a-40f2-9328-62efd03c9a1c" returned: 0 in 0.857s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "cinder-quobyte-ad69491a-f71a-40f2-9328-62efd03c9a1c" released by "delete_volume" :: held 1.792s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.quota [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Created reservations ['47472c31-d531-44e5-a6aa-e69071e43c8c', '52a9bcc1-cb69-4cc6-8f71-abab6ae4a46f', '2f066bcb-f8f4-444a-a985-aa10e5c8e98d', 'aa27633c-9713-4b29-889e-be403ba1f77b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:40 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:40 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:41 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.858s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.manager [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Deleted volume successfully. Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-ad9a8512-43bd-4ff3-af52-af224e8d6559 req-cb440b1e-19e1-4c46-9c8e-08dc50c4045e tempest-VolumesGetTestJSON-938644407 None] Lock "cinder-ad69491a-f71a-40f2-9328-62efd03c9a1c-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Acquiring lock "cinder-cce66692-61b5-4fb3-9411-ef2e4688a00d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "cinder-cce66692-61b5-4fb3-9411-ef2e4688a00d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Acquiring lock "cinder-quobyte-cce66692-61b5-4fb3-9411-ef2e4688a00d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "cinder-quobyte-cce66692-61b5-4fb3-9411-ef2e4688a00d" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[279e3b29-962f-417e-b70c-12233560f2bf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:42 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d Jul 08 16:26:42 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-6d51278a-b51f-4ef7-a6ca-6164b1c05af4 req-0f58cee7-6aaf-4038-b4b4-02bfbe5857c6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Terminate volume connection completed successfully. Jul 08 16:26:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-6d51278a-b51f-4ef7-a6ca-6164b1c05af4 req-0f58cee7-6aaf-4038-b4b4-02bfbe5857c6 tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleting attachment 9cb1a557-1e76-4211-858a-f2149d1c9220. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:42 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d" returned: 0 in 0.961s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:42 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d Jul 08 16:26:42 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:43 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-cce66692-61b5-4fb3-9411-ef2e4688a00d" returned: 0 in 0.781s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "cinder-quobyte-cce66692-61b5-4fb3-9411-ef2e4688a00d" released by "delete_volume" :: held 1.785s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=123,cinder:DELETE=13 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Created reservations ['fb149356-5978-49b0-90c5-c03c33c44b83', 'b13dbf89-6638-4337-8441-6f50628db3da', 'f6704c3f-c56d-435e-a833-713512752976', '0fb1a706-f66c-4b0a-8b49-29664636062a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:43 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:43 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:44 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.732s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:44 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Deleted volume successfully. Jul 08 16:26:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5f935167-11ce-4f95-8b3a-bbb2a6056e0d tempest-VolumesTransfersTest-144193860 None] Lock "cinder-cce66692-61b5-4fb3-9411-ef2e4688a00d-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-200d714c-0ce4-4592-b617-f77e9191437e-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-200d714c-0ce4-4592-b617-f77e9191437e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "cinder-quobyte-200d714c-0ce4-4592-b617-f77e9191437e" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:26:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-200d714c-0ce4-4592-b617-f77e9191437e" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:26:46 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58d2111-acc1-4c61-b463-6ead9ad681c2]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:46 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:26:46 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8a58d47c-ed82-42c3-8bb8-5e1625e1695d tempest-GroupsV320Test-1674184946 None] Group tempest-GroupsV320Test-Group-1430108755: creating Jul 08 16:26:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8a58d47c-ed82-42c3-8bb8-5e1625e1695d tempest-GroupsV320Test-1674184946 None] Group tempest-GroupsV320Test-Group-1430108755: created successfully Jul 08 16:26:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8a58d47c-ed82-42c3-8bb8-5e1625e1695d tempest-GroupsV320Test-1674184946 None] Create group completed successfully. Jul 08 16:26:47 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 0.987s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:47 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:26:47 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:47 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 1 in 0.827s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:26:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:48 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e Jul 08 16:26:48 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Created reservations ['0af49f79-0f43-41e7-95cd-b508c20ea96a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:48 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:48 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:48 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-200d714c-0ce4-4592-b617-f77e9191437e" returned: 0 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-quobyte-200d714c-0ce4-4592-b617-f77e9191437e" released by "delete_volume" :: held 2.781s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:48 devstack cinder-volume[87227]: WARNING cinder.quota [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25374799-1338879367 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25374799-1338879367, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:48 devstack cinder-volume[87227]: WARNING cinder.quota [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25374799-1338879367 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25374799-1338879367, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:26:48 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Created reservations ['7a3598a4-a554-4b30-acdb-48ca7df4a986', '458127d7-e438-476c-981e-787a664712a6', '6d837432-203d-42c3-a6e3-25010eb8e4dc', '049f7c5c-8136-42bd-a4f6-9e56a460f674'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:49 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:26:49 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:49 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.762s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-582c2ad2-55a4-4d3a-bd22-e8766c683db9 tempest-GroupsV320Test-1674184946 None] Delete group completed successfully. Jul 08 16:26:49 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.934s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:49 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:26:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Deleted volume successfully. Jul 08 16:26:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b564e0d9-6dd5-469f-af4e-8ceebf189d3c tempest-TestInstancesWithCinderVolumes-2138098215 None] Lock "cinder-200d714c-0ce4-4592-b617-f77e9191437e-delete_volume" released by "delete_volume" :: held 4.050s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:26:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a5179-13a0-4d9a-9d00-4320a8bb52e7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:50 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 Jul 08 16:26:50 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:51 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552" returned: 0 in 0.994s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.027s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-7212778f-90f5-4e64-b7e3-8f1beab31552', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3589136-2830-4b20-9108-ac819062a482', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:26:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-4279edd7-d29f-4c37-bab2-154a5d2a9022 req-103fba75-9d41-4e8f-976c-6e789a99ba10 tempest-TestServerVolumeAttachmentScenario-844736232 None] attachment_update completed successfully. Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Flow 'volume_create_manager' (3c0d3bb5-d9e6-4247-b98d-902f76723cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d7b830-9eb8-4cc5-8192-bea381d436ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d7b830-9eb8-4cc5-8192-bea381d436ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-63564887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c501d7c9-cb28-4c32-a3de-269df3314fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b3d9ed645d4b41bb6c4a10549322a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:52Z,use_quota=True,user_id='e956e48d81cf4a62a3f0b8efaae76891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbe0ac2-40b4-411d-b281-f5d2eb5cc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbe0ac2-40b4-411d-b281-f5d2eb5cc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411eaa4d-03df-4ba6-b360-e863aa189ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411eaa4d-03df-4ba6-b360-e863aa189ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c501d7c9-cb28-4c32-a3de-269df3314fad', 'volume_name': 'volume-c501d7c9-cb28-4c32-a3de-269df3314fad', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fde560-faf1-404c-951c-a070cf2a9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fde560-faf1-404c-951c-a070cf2a9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0e5e43-f0c8-4400-bcdf-ef0311e21aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Volume c501d7c9-cb28-4c32-a3de-269df3314fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c501d7c9-cb28-4c32-a3de-269df3314fad', 'volume_size': 1} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-63564887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c501d7c9-cb28-4c32-a3de-269df3314fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b3d9ed645d4b41bb6c4a10549322a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:52Z,use_quota=True,user_id='e956e48d81cf4a62a3f0b8efaae76891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Creating volume c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:26:51 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:26:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:51 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad 1073741824 Jul 08 16:26:51 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:53 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad 1073741824" returned: 0 in 1.124s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:53 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:26:53 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:53 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 0.779s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0e5e43-f0c8-4400-bcdf-ef0311e21aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c501d7c9-cb28-4c32-a3de-269df3314fad', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfce88e-097d-4478-813e-c9f26ad8e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:53 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Volume volume-c501d7c9-cb28-4c32-a3de-269df3314fad (c501d7c9-cb28-4c32-a3de-269df3314fad): created successfully Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfce88e-097d-4478-813e-c9f26ad8e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Flow 'volume_create_manager' (3c0d3bb5-d9e6-4247-b98d-902f76723cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-bdacb731-ddbb-4b88-9f86-9c1701073073 tempest-VolumesCloneTest-1230629724 None] Created volume successfully. Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Flow 'volume_create_manager' (b6fbc483-405d-4b56-a9c7-c465d2fc9741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4173afe-1fe4-4039-bf10-62b4e63784e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4173afe-1fe4-4039-bf10-62b4e63784e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-681756237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee77053-575c-4397-8c8b-72cbe0bb9154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b3d9ed645d4b41bb6c4a10549322a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c501d7c9-cb28-4c32-a3de-269df3314fad,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:56Z,use_quota=True,user_id='e956e48d81cf4a62a3f0b8efaae76891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a082321f-032f-4529-924e-a691525a045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a082321f-032f-4529-924e-a691525a045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f335c893-62c3-464c-a3d0-78859e77e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f335c893-62c3-464c-a3d0-78859e77e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1ee77053-575c-4397-8c8b-72cbe0bb9154', 'volume_name': 'volume-1ee77053-575c-4397-8c8b-72cbe0bb9154', 'volume_size': 2, 'source_volid': 'c501d7c9-cb28-4c32-a3de-269df3314fad', 'source_volstatus': 'available'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415efcab-f0ea-42df-a2e4-9fd82f5a97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415efcab-f0ea-42df-a2e4-9fd82f5a97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8596ad2-900f-4a72-ad4d-c7cdf8cad262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Volume 1ee77053-575c-4397-8c8b-72cbe0bb9154: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1ee77053-575c-4397-8c8b-72cbe0bb9154', 'volume_size': 2, 'source_volid': 'c501d7c9-cb28-4c32-a3de-269df3314fad', 'source_volstatus': 'available'} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:26:55 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Cloning volume c501d7c9-cb28-4c32-a3de-269df3314fad to volume 1ee77053-575c-4397-8c8b-72cbe0bb9154 Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Creating offline snapshot 2dd0524b-798f-48f2-ab7c-7b21191671cf of volume c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b399f51-7e39-41a8-8147-6046f94e4275]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:26:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:55 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:26:55 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Flow 'volume_create_manager' (7b3931fc-cdb2-419d-8548-903d9470a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856f4d5-1f41-4d08-a6d2-9bef3ef28291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856f4d5-1f41-4d08-a6d2-9bef3ef28291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-776322855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e47736f-37c8-4b0a-ade9-6b984862cf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2adab064d24e16a056e1f4d55329bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:56Z,use_quota=True,user_id='4cfd4532f1a240829663340e502a6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53978bf-058c-40cf-8bea-ea4589120dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53978bf-058c-40cf-8bea-ea4589120dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd035e9e-54cd-4e14-9e24-4300c117fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd035e9e-54cd-4e14-9e24-4300c117fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e47736f-37c8-4b0a-ade9-6b984862cf50', 'volume_name': 'volume-2e47736f-37c8-4b0a-ade9-6b984862cf50', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a27dbc-e89b-44e4-b2a5-4a7e10002380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a27dbc-e89b-44e4-b2a5-4a7e10002380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ba506-8d0d-4945-a864-9e765456c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:26:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Volume 2e47736f-37c8-4b0a-ade9-6b984862cf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e47736f-37c8-4b0a-ade9-6b984862cf50', 'volume_size': 1} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:26:56 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 1.079s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:56 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf 1G Jul 08 16:26:56 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:57 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf 1G" returned: 0 in 0.907s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c501d7c9-cb28-4c32-a3de-269df3314fad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:57 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c501d7c9-cb28-4c32-a3de-269df3314fad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:26:57 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-f5bcdc22-ec1e-44b4-ac50-faee0a42bd32 req-a2f6c70e-c4cb-48fe-8602-fbb02e7a47b0 tempest-TestServerVolumeAttachmentScenario-844736232 None] Terminate volume connection completed successfully. Jul 08 16:26:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-f5bcdc22-ec1e-44b4-ac50-faee0a42bd32 req-a2f6c70e-c4cb-48fe-8602-fbb02e7a47b0 tempest-TestServerVolumeAttachmentScenario-844736232 None] Deleting attachment a3589136-2830-4b20-9108-ac819062a482. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:26:58 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c501d7c9-cb28-4c32-a3de-269df3314fad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.819s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:58 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf is being set with open permissions: ugo+rw Jul 08 16:26:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:58 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:26:58 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:26:59 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 08 16:26:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.721s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:26:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:26:59 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info Jul 08 16:26:59 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:00 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info" returned: 0 in 0.692s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:00 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info is being set with open permissions: ugo+rw Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:00 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info Jul 08 16:27:00 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:00 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.info" returned: 0 in 0.743s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] snapshot: 2dd0524b-798f-48f2-ab7c-7b21191671cf, volume: 1ee77053-575c-4397-8c8b-72cbe0bb9154, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a9d399-1734-49c1-a05f-f62bf089bd18]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:01 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:27:01 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:01 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c501d7c9-cb28-4c32-a3de-269df3314fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f99d7f-cf24-41ee-b4b7-e04256408e4e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-e741fe38-d2db-4a00-b7b4-4f27924ad60f req-f49ea9c7-a041-4fbe-b766-bc25673bc933 tempest-TestServerVolumeAttachmentScenario-844736232 None] Terminate volume connection completed successfully. Jul 08 16:27:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-e741fe38-d2db-4a00-b7b4-4f27924ad60f req-f49ea9c7-a041-4fbe-b766-bc25673bc933 tempest-TestServerVolumeAttachmentScenario-844736232 None] Deleting attachment fd381dcf-0bed-4aec-81fb-e10e7954c2a4. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:27:01 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:27:01 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:02 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:02 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:27:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:02 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 Jul 08 16:27:02 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:08 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154" returned: 0 in 5.821s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f01968-8159-46f2-b8a6-64d012f66f9b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:08 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:27:08 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=108,cinder:UPDATE=123,cinder:INSERT=30,cinder:DELETE=5 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Flow 'volume_create_manager' (9c4d7867-5e1c-4a05-b5a6-2ee2c48e6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537c9dd-3925-44f6-a667-25fab7692b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537c9dd-3925-44f6-a667-25fab7692b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7455f8-893b-488a-bc43-765407bd5369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9af2dcfab24ad39f9d7c49b072366a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:09Z,use_quota=True,user_id='40df3a17235c48c0a92ed0c2f2d0d857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec7dc77c-d3ef-4f6d-b556-d31165d43c60),volume_type_id=ec7dc77c-d3ef-4f6d-b556-d31165d43c60)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53265ef1-fc1c-42d7-8879-cebe57189cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53265ef1-fc1c-42d7-8879-cebe57189cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b784ce1-e07c-4dd2-a1b7-a8cc8ea5e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:27:09 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 1.131s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:27:09 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Converted 1024.00 MB image at 175.86 MB/s Jul 08 16:27:09 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 is being set with open permissions: ugo+rw Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:09 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 Jul 08 16:27:09 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b784ce1-e07c-4dd2-a1b7-a8cc8ea5e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd7455f8-893b-488a-bc43-765407bd5369', 'volume_name': 'volume-fd7455f8-893b-488a-bc43-765407bd5369', 'volume_size': 1, 'image_id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10cc9dc90f1605ddc126d27184f952b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e9af2dcfab24ad39f9d7c49b072366a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34ccec30005c4309066fee2c0b928c2099e994eb81549bedecd5e86d1a489504f871e2719b6c465e9d3451ddacc2434a900775f3476b7cf1ed587a0bbc55f361', 'id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'created_at': datetime.datetime(2026, 7, 8, 14, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 27, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc7b286c-175c-4a3d-8746-cdb6109248ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a217885-5e1c-428e-a103-6f646222e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a217885-5e1c-428e-a103-6f646222e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46c6e45-3b41-4c8d-9546-1fcc6b9c1ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:09 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Volume fd7455f8-893b-488a-bc43-765407bd5369: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd7455f8-893b-488a-bc43-765407bd5369', 'volume_size': 1, 'image_id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10cc9dc90f1605ddc126d27184f952b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e9af2dcfab24ad39f9d7c49b072366a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34ccec30005c4309066fee2c0b928c2099e994eb81549bedecd5e86d1a489504f871e2719b6c465e9d3451ddacc2434a900775f3476b7cf1ed587a0bbc55f361', 'id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'created_at': datetime.datetime(2026, 7, 8, 14, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 27, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc7b286c-175c-4a3d-8746-cdb6109248ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Trying to clone fd7455f8-893b-488a-bc43-765407bd5369 from image cc7b286c-175c-4a3d-8746-cdb6109248ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:27:09 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Image download 0.00 MB at 0.00 MB/s Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3e678-ff63-41e3-adb3-e78907d99945]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:10 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:10 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:10 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154" returned: 0 in 0.697s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" released by "_copy_volume_from_snapshot" :: held 9.448s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-quobyte-2dd0524b-798f-48f2-ab7c-7b21191671cf" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-2dd0524b-798f-48f2-ab7c-7b21191671cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Deleting offline snapshot 2dd0524b-798f-48f2-ab7c-7b21191671cf of volume c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] snapshot_file for this snap is: volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a01f1-76ac-479a-95f8-22874a3786df]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:10 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:27:10 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:10 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:10 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:10 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:11 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.817s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c501d7c9-cb28-4c32-a3de-269df3314fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c04664-9993-4252-b1f4-ab4ff230d754]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:11 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:27:11 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:11 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 1 in 0.820s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Temporary image cc7b286c-175c-4a3d-8746-cdb6109248ba is fetched for user 40df3a17235c48c0a92ed0c2f2d0d857. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab61e29-bf35-42d1-bfa1-bed5bff6e5a0]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:11 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:11 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:12 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:12 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:27:12 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:12 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:12 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:12 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:12 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.791s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:12 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf Jul 08 16:27:12 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:13 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:13 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad.2dd0524b-798f-48f2-ab7c-7b21191671cf" returned: 0 in 0.669s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-2dd0524b-798f-48f2-ab7c-7b21191671cf" released by "_delete_snapshot" :: held 3.162s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.807s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.143s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-776322855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e47736f-37c8-4b0a-ade9-6b984862cf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2adab064d24e16a056e1f4d55329bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:26:56Z,use_quota=True,user_id='4cfd4532f1a240829663340e502a6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Creating volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:13 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:13 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 1073741824 Jul 08 16:27:13 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8596ad2-900f-4a72-ad4d-c7cdf8cad262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee77053-575c-4397-8c8b-72cbe0bb9154', 'volume_size': 2, 'source_volid': 'c501d7c9-cb28-4c32-a3de-269df3314fad', 'source_volstatus': 'available'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb93e01d-9df5-4bfa-aba2-9a997abd68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:13 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Volume volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 (1ee77053-575c-4397-8c8b-72cbe0bb9154): created successfully Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb93e01d-9df5-4bfa-aba2-9a997abd68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Flow 'volume_create_manager' (b6fbc483-405d-4b56-a9c7-c465d2fc9741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e5e07e04-316c-4843-9b77-6113af09e673 tempest-VolumesCloneTest-1230629724 None] Created volume successfully. Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "cinder-7212778f-90f5-4e64-b7e3-8f1beab31552-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-1ee77053-575c-4397-8c8b-72cbe0bb9154-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-7212778f-90f5-4e64-b7e3-8f1beab31552-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-1ee77053-575c-4397-8c8b-72cbe0bb9154-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "cinder-quobyte-7212778f-90f5-4e64-b7e3-8f1beab31552" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-quobyte-7212778f-90f5-4e64-b7e3-8f1beab31552" acquired by "delete_volume" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3245ce9e-c863-40ec-a746-b8f63e6bf3a4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc71174-e549-467a-bed7-b780efeeaad5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:14 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 Jul 08 16:27:14 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:14 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 Jul 08 16:27:14 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:14 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 1073741824" returned: 0 in 1.000s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:14 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 Jul 08 16:27:14 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:15 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:15 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154 Jul 08 16:27:15 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:15 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552" returned: 0 in 0.848s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:15 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552 Jul 08 16:27:15 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:15 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50" returned: 0 in 0.668s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7455f8-893b-488a-bc43-765407bd5369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9af2dcfab24ad39f9d7c49b072366a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:09Z,use_quota=True,user_id='40df3a17235c48c0a92ed0c2f2d0d857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec7dc77c-d3ef-4f6d-b556-d31165d43c60),volume_type_id=ec7dc77c-d3ef-4f6d-b556-d31165d43c60)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Creating volume fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:15 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ba506-8d0d-4945-a864-9e765456c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e47736f-37c8-4b0a-ade9-6b984862cf50', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1396d1-4c36-47cf-84e4-f1180454ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:15 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1073741824 Jul 08 16:27:15 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Volume volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 (2e47736f-37c8-4b0a-ade9-6b984862cf50): created successfully Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1396d1-4c36-47cf-84e4-f1180454ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Flow 'volume_create_manager' (7b3931fc-cdb2-419d-8548-903d9470a322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-955537f3-f480-4a5d-86e7-75a4bfd32aa9 tempest-SnapshotsActionsTest-1565240630 None] Created volume successfully. Jul 08 16:27:15 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1ee77053-575c-4397-8c8b-72cbe0bb9154" returned: 0 in 0.674s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-1ee77053-575c-4397-8c8b-72cbe0bb9154" released by "delete_volume" :: held 1.506s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Created reservations ['2a7fffc9-dcce-4281-9c64-0d835eccfe2c', '8a7f21ef-9874-4638-9b6c-29469d3a4052', 'a1eaaf8d-94a8-48da-81cb-d88ea2c302e3', 'ce66ff3f-be6f-48af-b6f6-5f743fdc0291'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:15 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7212778f-90f5-4e64-b7e3-8f1beab31552" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-quobyte-7212778f-90f5-4e64-b7e3-8f1beab31552" released by "delete_volume" :: held 1.622s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:16 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:16 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Created reservations ['7988223b-fd66-483a-9eac-9cea4135ebda', '56819943-6d97-4844-bd00-173096d7ae97', '82b1e2f8-e665-4812-97d4-d0e7383d45c2', 'd2ef02c1-9edf-47cc-b36e-86307a433445'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:16 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:16 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:16 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1073741824" returned: 0 in 1.025s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:16 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:16 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "cinder-53c8a1b8-ffce-4444-9f2a-453d1eaabf72-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-53c8a1b8-ffce-4444-9f2a-453d1eaabf72-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-c501d7c9-cb28-4c32-a3de-269df3314fad-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "cinder-quobyte-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-c501d7c9-cb28-4c32-a3de-269df3314fad-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-quobyte-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" acquired by "delete_volume" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:16 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Deleted volume successfully. Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb8542-8f37-4908-90d0-7fd70a328db6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "cinder-quobyte-c501d7c9-cb28-4c32-a3de-269df3314fad" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-60fc49fc-2296-42ed-8157-8bfaae305c48 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-1ee77053-575c-4397-8c8b-72cbe0bb9154-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-c501d7c9-cb28-4c32-a3de-269df3314fad" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6635db36-3bcf-4b91-aa8c-2d7f23db96d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:17 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.835s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:17 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 Jul 08 16:27:17 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Deleted volume successfully. Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7c4dbaee-9d8a-44b6-bdf8-ddca57ca8887 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-7212778f-90f5-4e64-b7e3-8f1beab31552-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:17 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:27:17 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:17 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.934s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Creating offline snapshot 154af7d1-f28c-4410-9884-840df89ec780 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Attempting download of cc7b286c-175c-4a3d-8746-cdb6109248ba ((None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}])) to volume fd7455f8-893b-488a-bc43-765407bd5369. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb8066-ee9b-4232-8af6-820b24dca894]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c37d831-5706-4fd7-b95f-229395d4526c]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:17 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 Jul 08 16:27:17 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:17 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt Jul 08 16:27:17 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:17 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" returned: 0 in 0.914s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:17 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72 Jul 08 16:27:17 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:17 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:17 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad Jul 08 16:27:17 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:18 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50" returned: 0 in 0.875s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:18 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt" returned: 0 in 0.820s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:18 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 1G Jul 08 16:27:18 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:18 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt Jul 08 16:27:18 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:18 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c501d7c9-cb28-4c32-a3de-269df3314fad" returned: 0 in 0.712s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-quobyte-c501d7c9-cb28-4c32-a3de-269df3314fad" released by "delete_volume" :: held 1.628s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:18 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" returned: 0 in 0.801s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-quobyte-53c8a1b8-ffce-4444-9f2a-453d1eaabf72" released by "delete_volume" :: held 1.792s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Created reservations ['5f81770a-0bc6-46aa-9226-1bf10e3610e8', 'b192bb01-b734-43dc-8007-fab9d22f7bcd', 'ae953afb-c510-4d8f-b68a-f1e7ea0cbc7a', '3217d51c-896d-420a-b260-44f42115fb4a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Created reservations ['bc15fa2e-161b-442a-96bc-01af93689f89', '1c33b7c3-e476-46d1-acf7-5cb2e131fb9f', '2ce3cf00-35a9-4123-b38c-bfdef35a98c7', '5d6bd5c2-8e1d-4279-a7ea-d55c05310ccb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:18 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:18 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:18 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:18 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:19 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:19 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt" returned: 1 in 0.952s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc7b286c-175c-4a3d-8746-cdb6109248ba_jbzy07tt' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 1G" returned: 0 in 0.973s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d11c975-af87-4e9c-b1f1-3d4b2bf22249]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:19 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:19 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:19 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:19 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:19 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:19 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:19 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.027s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Deleted volume successfully. Jul 08 16:27:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4f0ae117-31c1-4b8c-8bc4-e2e6f22ccdf5 tempest-VolumesCloneTest-1230629724 None] Lock "cinder-c501d7c9-cb28-4c32-a3de-269df3314fad-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:20 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.335s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Deleted volume successfully. Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f595555a-8e99-4487-9394-668710999c07 tempest-TestServerVolumeAttachmentScenario-844736232 None] Lock "cinder-53c8a1b8-ffce-4444-9f2a-453d1eaabf72-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:20 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.343s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:20 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 is being set with open permissions: ugo+rw Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:20 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.036s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:20 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:27:20 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:27:20 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 0 in 1.374s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:20 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD Jul 08 16:27:20 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:21 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.861s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:21 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info Jul 08 16:27:21 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:21 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD" returned: 1 in 1.018s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] cc7b286c-175c-4a3d-8746-cdb6109248ba was raw, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:27:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:21 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:21 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:22 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info" returned: 0 in 0.751s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:22 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info is being set with open permissions: ugo+rw Jul 08 16:27:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:22 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info Jul 08 16:27:22 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:22 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 0 in 0.988s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:22 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc7b286c-175c-4a3d-8746-cdb6109248ba_6pnqzlyxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:27:22 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 16:27:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:22 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1G Jul 08 16:27:22 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:23 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.info" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.904s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-320b37e8-f67a-4219-8863-7adc06bf7c3a tempest-SnapshotsActionsTest-1565240630 None] Create snapshot completed successfully Jul 08 16:27:23 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 1G" returned: 0 in 0.877s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c9540-b1b6-4576-9e00-1afd3a63f0a9]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:23 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:23 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Creating offline snapshot aea36a98-92e8-4d46-9334-4a455fd7a213 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:24 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 0 in 1.117s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8c8af9-be22-4e30-81c1-2af01be4797e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:24 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:24 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:24 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:24 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:25 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 1 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Downloaded image cc7b286c-175c-4a3d-8746-cdb6109248ba ((None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}])) to volume fd7455f8-893b-488a-bc43-765407bd5369 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Temporary image cc7b286c-175c-4a3d-8746-cdb6109248ba for user 40df3a17235c48c0a92ed0c2f2d0d857 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Marking volume fd7455f8-893b-488a-bc43-765407bd5369 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Copying metadata from image cc7b286c-175c-4a3d-8746-cdb6109248ba to fd7455f8-893b-488a-bc43-765407bd5369. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Creating volume glance metadata for volume fd7455f8-893b-488a-bc43-765407bd5369 backed by image cc7b286c-175c-4a3d-8746-cdb6109248ba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '10cc9dc90f1605ddc126d27184f952b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46c6e45-3b41-4c8d-9546-1fcc6b9c1ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7455f8-893b-488a-bc43-765407bd5369', 'volume_size': 1, 'image_id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc7b286c-175c-4a3d-8746-cdb6109248ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10cc9dc90f1605ddc126d27184f952b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e9af2dcfab24ad39f9d7c49b072366a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34ccec30005c4309066fee2c0b928c2099e994eb81549bedecd5e86d1a489504f871e2719b6c465e9d3451ddacc2434a900775f3476b7cf1ed587a0bbc55f361', 'id': 'cc7b286c-175c-4a3d-8746-cdb6109248ba', 'created_at': datetime.datetime(2026, 7, 8, 14, 27, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 27, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc7b286c-175c-4a3d-8746-cdb6109248ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1325e82-57f0-4cf6-966b-5fc58a599e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Volume volume-fd7455f8-893b-488a-bc43-765407bd5369 (fd7455f8-893b-488a-bc43-765407bd5369): created successfully Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1325e82-57f0-4cf6-966b-5fc58a599e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Flow 'volume_create_manager' (9c4d7867-5e1c-4a05-b5a6-2ee2c48e6a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:25 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.084s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f5dfa1bd-128c-440d-8d08-7a86356cb9f8 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Created volume successfully. Jul 08 16:27:25 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 1G Jul 08 16:27:25 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Acquiring lock "cinder-fd7455f8-893b-488a-bc43-765407bd5369-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "cinder-fd7455f8-893b-488a-bc43-765407bd5369-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Acquiring lock "cinder-quobyte-fd7455f8-893b-488a-bc43-765407bd5369" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "cinder-quobyte-fd7455f8-893b-488a-bc43-765407bd5369" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f4b60-dc55-4fdb-90d7-c826fa93afef]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:26 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:26 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:26 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 1G" returned: 0 in 1.068s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:26 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 Jul 08 16:27:26 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:27 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 0 in 1.160s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:27 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:27 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:27 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213" returned: 0 in 1.170s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:27 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 is being set with open permissions: ugo+rw Jul 08 16:27:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:27 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 Jul 08 16:27:27 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:28 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 1 in 1.016s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:27:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:28 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369 Jul 08 16:27:28 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:29 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213" returned: 0 in 1.308s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-03ab2d2b-2369-400c-8661-ef9bfc0b0543 tempest-SnapshotsActionsTest-1565240630 None] Create snapshot completed successfully Jul 08 16:27:29 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fd7455f8-893b-488a-bc43-765407bd5369" returned: 0 in 1.081s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "cinder-quobyte-fd7455f8-893b-488a-bc43-765407bd5369" released by "delete_volume" :: held 3.345s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:29 devstack cinder-volume[87227]: WARNING cinder.quota [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:27:29 devstack cinder-volume[87227]: WARNING cinder.quota [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Created reservations ['656e94a6-92c3-4955-919c-efd02aa5902e', '0f8b995b-7f56-42ea-bbc8-4782bacf5342', '76caf48b-35ea-4215-b55d-c42f01f3c421', '4c338259-7bc6-4892-9769-a18481b097bc'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:29 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:29 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-aea36a98-92e8-4d46-9334-4a455fd7a213-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-aea36a98-92e8-4d46-9334-4a455fd7a213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-aea36a98-92e8-4d46-9334-4a455fd7a213" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-aea36a98-92e8-4d46-9334-4a455fd7a213" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Deleting offline snapshot aea36a98-92e8-4d46-9334-4a455fd7a213 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] snapshot_file for this snap is: volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50c205-a7cb-42f0-a907-b4e636707d12]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:30 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 Jul 08 16:27:30 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:30 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.983s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Deleted volume successfully. Jul 08 16:27:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c0f2f6e-2a78-47f0-806a-98c9b80ed073 tempest-VolumeAndVolumeTypeFromImageTest-577037341 None] Lock "cinder-fd7455f8-893b-488a-bc43-765407bd5369-delete_volume" released by "delete_volume" :: held 4.685s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:31 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213" returned: 0 in 1.325s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d50e9d-1e90-4658-91b8-16194d6270fb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:31 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:31 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:32 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.056s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:32 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 Jul 08 16:27:32 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:33 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213" returned: 0 in 1.073s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:33 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213 Jul 08 16:27:33 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Flow 'volume_create_manager' (243cef0e-c056-4089-a3cb-740a011e567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64982ef-ed16-436a-b54d-f0e66686bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64982ef-ed16-436a-b54d-f0e66686bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d5e8ed-e3df-46c1-b323-58fe8c161728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a220c1373d4c56be830324e3674b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:34Z,use_quota=True,user_id='ce1ea31d472c422ead2e8854e77c9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e67d22d-0797-4dce-bdc6-17a22ec6e2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e67d22d-0797-4dce-bdc6-17a22ec6e2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba62dee-0678-478e-aea6-89f536f221e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba62dee-0678-478e-aea6-89f536f221e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d5e8ed-e3df-46c1-b323-58fe8c161728', 'volume_name': 'volume-41d5e8ed-e3df-46c1-b323-58fe8c161728', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2405a0af-21ad-4c2b-a35f-e79edc5d65aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2405a0af-21ad-4c2b-a35f-e79edc5d65aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80474fd2-ff26-4102-91e0-4331e736f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Volume 41d5e8ed-e3df-46c1-b323-58fe8c161728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d5e8ed-e3df-46c1-b323-58fe8c161728', 'volume_size': 1} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d5e8ed-e3df-46c1-b323-58fe8c161728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a220c1373d4c56be830324e3674b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:34Z,use_quota=True,user_id='ce1ea31d472c422ead2e8854e77c9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Creating volume 41d5e8ed-e3df-46c1-b323-58fe8c161728 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:33 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:27:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:33 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 1073741824 Jul 08 16:27:33 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:34 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aea36a98-92e8-4d46-9334-4a455fd7a213" returned: 0 in 0.861s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-aea36a98-92e8-4d46-9334-4a455fd7a213" released by "_delete_snapshot" :: held 4.488s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_snapshot" :: held 4.530s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Created reservations ['6401d8af-a101-4845-a2ef-569ad08d2512', '1b0cf9d1-e42e-4047-a027-678af16093ca', 'bb90055a-9205-483f-9225-00307d04ff42', '027a89ff-2688-4856-891b-cb8d4451e4d9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Delete snapshot completed successfully. Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-418f8082-ab2e-4bb5-a883-a21a596cbdfa tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-aea36a98-92e8-4d46-9334-4a455fd7a213-delete_snapshot" released by "delete_snapshot" :: held 4.735s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:34 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 1073741824" returned: 0 in 1.103s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:35 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 Jul 08 16:27:35 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:35 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728" returned: 0 in 0.878s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80474fd2-ff26-4102-91e0-4331e736f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d5e8ed-e3df-46c1-b323-58fe8c161728', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a5cc5a-19c4-44b2-952d-15d2f5243642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Creating offline snapshot aece36b6-bee1-4231-bd98-219abb48f8c3 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:35 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Volume volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 (41d5e8ed-e3df-46c1-b323-58fe8c161728): created successfully Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a5cc5a-19c4-44b2-952d-15d2f5243642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Flow 'volume_create_manager' (243cef0e-c056-4089-a3cb-740a011e567b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f456a2f-6fd9-41d6-869a-37cad6040090]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:36 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-93d43772-8738-44b3-be80-84c0ba25ab7c tempest-CinderUnicodeTest-854313058 None] Created volume successfully. Jul 08 16:27:36 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:36 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:36 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.816s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:36 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 1G Jul 08 16:27:36 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Flow 'volume_create_manager' (1e7eddf7-6fe3-4b85-9103-70d913946102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f7e4f-01d1-4ede-9cba-fb9da6e9c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f7e4f-01d1-4ede-9cba-fb9da6e9c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-782958024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f970e-4c29-426e-96c3-f14fb57dc77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a220c1373d4c56be830324e3674b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:38Z,use_quota=True,user_id='ce1ea31d472c422ead2e8854e77c9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a47634-6e42-4ae0-a311-227cd5f998bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a47634-6e42-4ae0-a311-227cd5f998bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f069e-fc90-48cd-add5-35c13327d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f069e-fc90-48cd-add5-35c13327d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9f970e-4c29-426e-96c3-f14fb57dc77c', 'volume_name': 'volume-df9f970e-4c29-426e-96c3-f14fb57dc77c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43164a3b-2776-4012-a5a3-f52ea449a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43164a3b-2776-4012-a5a3-f52ea449a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318d44d1-be0c-4b1a-9e01-ffb60b08db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Volume df9f970e-4c29-426e-96c3-f14fb57dc77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9f970e-4c29-426e-96c3-f14fb57dc77c', 'volume_size': 1} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 1G" returned: 0 in 1.087s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:27:37 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 Jul 08 16:27:37 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Flow 'volume_create_manager' (a40b28aa-03e6-4e38-9b7c-d338c959bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d3d272-edea-4f58-bca8-9cff60b2ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d3d272-edea-4f58-bca8-9cff60b2ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1587446944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6f6861-6b82-4bba-8eac-e09845cda1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d80842191604f3598610aa5ff1a1970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:38Z,use_quota=True,user_id='718667ee3b1641eb8cab40abd355b552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b442d-dde8-4cd8-a38a-7daf4c933b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b442d-dde8-4cd8-a38a-7daf4c933b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da4697-2c47-4bd2-95ff-ca1cd1b65188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da4697-2c47-4bd2-95ff-ca1cd1b65188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6f6861-6b82-4bba-8eac-e09845cda1d0', 'volume_name': 'volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d96bff0-17fa-4365-9b44-d3e196b79f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d96bff0-17fa-4365-9b44-d3e196b79f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bdd324-4da3-46f5-b1e5-2890bbe02b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Volume 5f6f6861-6b82-4bba-8eac-e09845cda1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0', 'volume_size': 1} Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:38 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3" returned: 0 in 0.764s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:38 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 is being set with open permissions: ugo+rw Jul 08 16:27:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:38 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 Jul 08 16:27:38 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:39 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3" returned: 0 in 0.664s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.500s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-782958024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f970e-4c29-426e-96c3-f14fb57dc77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a220c1373d4c56be830324e3674b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:38Z,use_quota=True,user_id='ce1ea31d472c422ead2e8854e77c9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Creating volume df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:39 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:27:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:39 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c 1073741824 Jul 08 16:27:39 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5145e7fb-a72f-4c59-ae37-33bd617d2960 tempest-SnapshotsActionsTest-1565240630 None] Create snapshot completed successfully Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-aece36b6-bee1-4231-bd98-219abb48f8c3-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-aece36b6-bee1-4231-bd98-219abb48f8c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-aece36b6-bee1-4231-bd98-219abb48f8c3" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-aece36b6-bee1-4231-bd98-219abb48f8c3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Deleting offline snapshot aece36b6-bee1-4231-bd98-219abb48f8c3 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] snapshot_file for this snap is: volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f51fa7-7704-4b54-be63-bf09f1b04a5a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:40 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c 1073741824" returned: 0 in 0.972s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:40 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c Jul 08 16:27:40 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:40 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 Jul 08 16:27:40 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:41 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1587446944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6f6861-6b82-4bba-8eac-e09845cda1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d80842191604f3598610aa5ff1a1970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:38Z,use_quota=True,user_id='718667ee3b1641eb8cab40abd355b552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Creating volume 5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:41 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:41 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3" returned: 0 in 0.866s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:41 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 1073741824 Jul 08 16:27:41 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318d44d1-be0c-4b1a-9e01-ffb60b08db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9f970e-4c29-426e-96c3-f14fb57dc77c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d253ea-09d5-497a-ad8f-ce8ead19bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d82f3-f379-439d-bb98-81b7268d6ded]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Volume volume-df9f970e-4c29-426e-96c3-f14fb57dc77c (df9f970e-4c29-426e-96c3-f14fb57dc77c): created successfully Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d253ea-09d5-497a-ad8f-ce8ead19bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Flow 'volume_create_manager' (1e7eddf7-6fe3-4b85-9103-70d913946102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-508f963f-2022-46b1-b05a-c43f204a2ede tempest-CinderUnicodeTest-854313058 None] Created volume successfully. Jul 08 16:27:41 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:41 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:42 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.896s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:42 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 Jul 08 16:27:42 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:42 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 1073741824" returned: 0 in 1.071s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:42 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:27:42 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:43 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 0.832s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.026s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bdd324-4da3-46f5-b1e5-2890bbe02b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374a4d49-2f78-4fd3-8df2-17657c358d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Creating offline snapshot 1043d04e-8a16-47a9-bd30-71cbdf1b81c1 of volume df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Volume volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 (5f6f6861-6b82-4bba-8eac-e09845cda1d0): created successfully Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374a4d49-2f78-4fd3-8df2-17657c358d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:43 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Flow 'volume_create_manager' (a40b28aa-03e6-4e38-9b7c-d338c959bc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0632e4a7-6683-42e0-99ab-1433c193f967]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3" returned: 0 in 1.032s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-15a5e260-a7cc-462d-90f9-e1d133cb0fcb tempest-VolumeDependencyTests-527651841 None] Created volume successfully. Jul 08 16:27:43 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3 Jul 08 16:27:43 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:43 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c Jul 08 16:27:43 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:43 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.aece36b6-bee1-4231-bd98-219abb48f8c3" returned: 0 in 0.697s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-aece36b6-bee1-4231-bd98-219abb48f8c3" released by "_delete_snapshot" :: held 3.690s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_snapshot" :: held 3.720s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:43 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=26,cinder:UPDATE=92,cinder:SELECT=90,cinder:DELETE=10 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:27:44 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c" returned: 0 in 0.821s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:44 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 1G Jul 08 16:27:44 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Created reservations ['84b543a3-d3b1-4fa5-a6bd-3ae93b7a1ca1', 'f4f1aa46-2530-4024-ad8a-4f24e848ddcb', '37fda577-f09e-41b3-bf07-ed61fabe7eb0', 'aef6373b-59eb-4caa-b379-ee69558179ac'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Delete snapshot completed successfully. Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-58655f6c-298c-4cf6-a015-8ad7220d8ea7 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-aece36b6-bee1-4231-bd98-219abb48f8c3-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:45 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 1G" returned: 0 in 1.002s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9f970e-4c29-426e-96c3-f14fb57dc77c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:45 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9f970e-4c29-426e-96c3-f14fb57dc77c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 Jul 08 16:27:45 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:45 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9f970e-4c29-426e-96c3-f14fb57dc77c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1" returned: 0 in 0.734s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:45 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 is being set with open permissions: ugo+rw Jul 08 16:27:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:45 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 Jul 08 16:27:45 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:46 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1" returned: 0 in 0.663s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:46 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info Jul 08 16:27:46 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:47 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info" returned: 0 in 0.676s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:47 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info is being set with open permissions: ugo+rw Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:47 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info Jul 08 16:27:47 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:47 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.info" returned: 0 in 0.737s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.592s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Creating offline snapshot 9cfa6803-c27c-42bc-ba45-05225a19ffbb of volume 5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8a151f0c-519e-477d-9c95-53dcd52493fb tempest-CinderUnicodeTest-854313058 None] Create snapshot completed successfully Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d832c92-d94b-432f-85a5-91d253ab47c6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:48 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:27:48 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-1043d04e-8a16-47a9-bd30-71cbdf1b81c1-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-1043d04e-8a16-47a9-bd30-71cbdf1b81c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-quobyte-1043d04e-8a16-47a9-bd30-71cbdf1b81c1" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-1043d04e-8a16-47a9-bd30-71cbdf1b81c1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Deleting offline snapshot 1043d04e-8a16-47a9-bd30-71cbdf1b81c1 of volume df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] snapshot_file for this snap is: volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1d0f5-88b5-4a0c-81b1-b5d35cd0473a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:48 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 Jul 08 16:27:48 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:48 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:48 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb 1G Jul 08 16:27:48 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:49 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1" returned: 0 in 0.844s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9f970e-4c29-426e-96c3-f14fb57dc77c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d7dd4-21ae-439a-b645-c9220e017094]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:49 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c Jul 08 16:27:49 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:49 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb 1G" returned: 0 in 1.053s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:49 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:27:49 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:50 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:50 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 Jul 08 16:27:50 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:50 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 0.737s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:50 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb is being set with open permissions: ugo+rw Jul 08 16:27:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:50 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:27:50 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:51 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:51 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1 Jul 08 16:27:51 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:51 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:51 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info Jul 08 16:27:51 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:51 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c.1043d04e-8a16-47a9-bd30-71cbdf1b81c1" returned: 0 in 0.729s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-1043d04e-8a16-47a9-bd30-71cbdf1b81c1" released by "_delete_snapshot" :: held 3.341s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" released by "delete_snapshot" :: held 3.365s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Created reservations ['00bfe76e-45c7-40ff-9a54-e55b6955c5fa', '19b0f731-0616-444a-ba17-06c30cb87219', '63bfc3ea-dc53-4dc0-bb5f-083a57ceee8d', '266f1006-60bf-4c24-a28f-3adcb6f07404'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Delete snapshot completed successfully. Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3651ef20-0389-40c2-b9e0-6530d5df60c3 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-1043d04e-8a16-47a9-bd30-71cbdf1b81c1-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:52 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:52 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info is being set with open permissions: ugo+rw Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:52 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info Jul 08 16:27:52 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-df9f970e-4c29-426e-96c3-f14fb57dc77c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-df9f970e-4c29-426e-96c3-f14fb57dc77c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:52 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e059fcfa-1569-469b-ac9e-9fba5a4c2ef4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.info" returned: 0 in 0.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.092s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Creating offline snapshot ed2eb117-9231-42c4-b624-ac3a48a63c66 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:27:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b5f889c4-1e9b-4407-9aa8-60590f8f1d8c tempest-VolumeDependencyTests-527651841 None] Create snapshot completed successfully Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ffd210-be1d-4d4d-b87c-f242e9660d09]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:52 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c Jul 08 16:27:52 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:53 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:53 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:53 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:53 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c Jul 08 16:27:53 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:53 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.871s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:53 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 1G Jul 08 16:27:53 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Flow 'volume_create_manager' (309e5aca-e24e-4e5d-980a-e70e71d597cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49cd7f-3990-4a09-a4c2-0280ddf5b20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49cd7f-3990-4a09-a4c2-0280ddf5b20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1861825569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce174fe7-1ce9-4527-9713-3e19b38a7645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d80842191604f3598610aa5ff1a1970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9cfa6803-c27c-42bc-ba45-05225a19ffbb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:27:54Z,use_quota=True,user_id='718667ee3b1641eb8cab40abd355b552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee76ed58-4284-4871-9ec1-c2c2210b5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee76ed58-4284-4871-9ec1-c2c2210b5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825c875-82aa-495f-a0d8-e82f6afac353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825c875-82aa-495f-a0d8-e82f6afac353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce174fe7-1ce9-4527-9713-3e19b38a7645', 'volume_name': 'volume-ce174fe7-1ce9-4527-9713-3e19b38a7645', 'volume_size': 1, 'snapshot_id': '9cfa6803-c27c-42bc-ba45-05225a19ffbb'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb820a2-71bb-4f50-961e-92607db73d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb820a2-71bb-4f50-961e-92607db73d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a1a419-68ec-42bd-9682-1a4e1e91fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:27:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Volume ce174fe7-1ce9-4527-9713-3e19b38a7645: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce174fe7-1ce9-4527-9713-3e19b38a7645', 'volume_size': 1, 'snapshot_id': '9cfa6803-c27c-42bc-ba45-05225a19ffbb'} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:54 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-df9f970e-4c29-426e-96c3-f14fb57dc77c" returned: 0 in 0.771s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-df9f970e-4c29-426e-96c3-f14fb57dc77c" released by "delete_volume" :: held 1.659s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Created reservations ['c8dc1c3a-bf32-4cae-8a91-b815b1a5530a', '615eebc2-d094-4744-8f7d-b21a0a17d3c3', '6ad66ba8-0502-4551-9d32-0af86de0aa22', '6f595c71-9c2b-4858-ac0d-5c358055bb5d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:54 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:54 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:54 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 1G" returned: 0 in 0.969s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:54 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 Jul 08 16:27:54 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-41d5e8ed-e3df-46c1-b323-58fe8c161728-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-41d5e8ed-e3df-46c1-b323-58fe8c161728-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "cinder-quobyte-41d5e8ed-e3df-46c1-b323-58fe8c161728" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-41d5e8ed-e3df-46c1-b323-58fe8c161728" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c58c81-2889-42cb-95a6-d69fbb4e508b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:55 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 Jul 08 16:27:55 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:55 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.758s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Deleted volume successfully. Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-19df222a-4784-4dd6-a3b7-d9dbc74ff3d2 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-df9f970e-4c29-426e-96c3-f14fb57dc77c-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:55 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66" returned: 0 in 0.845s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:55 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 is being set with open permissions: ugo+rw Jul 08 16:27:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:55 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 Jul 08 16:27:55 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:56 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728" returned: 0 in 0.882s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:56 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728 Jul 08 16:27:56 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:56 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66" returned: 0 in 0.676s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.978s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb-ce174fe7-1ce9-4527-9713-3e19b38a7645" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb-ce174fe7-1ce9-4527-9713-3e19b38a7645" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Creating volume ce174fe7-1ce9-4527-9713-3e19b38a7645 from snapshot 9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7b862e84-9104-48f4-b0d9-7c5b9c7560e1 tempest-SnapshotsActionsTest-1565240630 None] Create snapshot completed successfully Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] snapshot: 9cfa6803-c27c-42bc-ba45-05225a19ffbb, volume: ce174fe7-1ce9-4527-9713-3e19b38a7645, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c0b26-e904-4e67-8fe6-4073c65b92c9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:56 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41d5e8ed-e3df-46c1-b323-58fe8c161728" returned: 0 in 0.678s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:56 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:27:56 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-quobyte-41d5e8ed-e3df-46c1-b323-58fe8c161728" released by "delete_volume" :: held 1.608s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Created reservations ['9f0aef09-862e-4b61-bb21-16e230a798df', '0571fe42-afb6-44b8-ab8f-3f09a062553c', '4829a2fb-f80a-402d-8c5f-f8ab17881e7c', 'c0f92d14-32a8-4655-b18e-54c0e46b8ee6'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:27:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:56 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:27:56 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:57 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 1.103s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-ed2eb117-9231-42c4-b624-ac3a48a63c66-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1993a2fa-ee6c-4096-9e73-7cc6e4cd9e81]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-ed2eb117-9231-42c4-b624-ac3a48a63c66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-ed2eb117-9231-42c4-b624-ac3a48a63c66" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-ed2eb117-9231-42c4-b624-ac3a48a63c66" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Deleting offline snapshot ed2eb117-9231-42c4-b624-ac3a48a63c66 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] snapshot_file for this snap is: volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ad8d3-1b71-47b5-b01f-f5f2159b2603]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:57 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:27:57 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:57 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.066s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:27:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Deleted volume successfully. Jul 08 16:27:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7b954748-22d7-4f6b-bbcd-1a2ff5a5ea06 tempest-CinderUnicodeTest-854313058 None] Lock "cinder-41d5e8ed-e3df-46c1-b323-58fe8c161728-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:27:58 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 Jul 08 16:27:58 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:58 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 1.215s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:58 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:27:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:58 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 Jul 08 16:27:58 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:27:59 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 08 16:27:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66" returned: 0 in 1.463s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:27:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:27:59 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a7467-69a0-43e3-87a7-c5c35de5d824]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:27:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:27:59 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:27:59 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:00 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.106s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:00 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 Jul 08 16:28:00 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:03 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66" returned: 0 in 2.636s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:03 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66 Jul 08 16:28:03 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:04 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.ed2eb117-9231-42c4-b624-ac3a48a63c66" returned: 0 in 1.895s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-ed2eb117-9231-42c4-b624-ac3a48a63c66" released by "_delete_snapshot" :: held 7.356s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_snapshot" :: held 7.402s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Flow 'volume_create_manager' (5981dca5-00fd-43dc-9036-f352e11c4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc015a5-fc0e-48c8-aa0c-75c533009c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc015a5-fc0e-48c8-aa0c-75c533009c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94437268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dab3e74-48a6-45a2-b42d-7181287af475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e8f586e8c6404c8f0e941a1bd02335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:05Z,use_quota=True,user_id='2c014089eacc45d8b67b4f80a675656e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04369755-3b66-4d87-b148-1e87fd2c0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04369755-3b66-4d87-b148-1e87fd2c0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48addfb9-0cd3-4d6a-ad28-87dfa6d0ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48addfb9-0cd3-4d6a-ad28-87dfa6d0ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dab3e74-48a6-45a2-b42d-7181287af475', 'volume_name': 'volume-5dab3e74-48a6-45a2-b42d-7181287af475', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d29877-b5cc-4c40-ab9d-dd419bc288cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d29877-b5cc-4c40-ab9d-dd419bc288cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66b41aa-cd9e-49b5-a485-d125b01243ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Volume 5dab3e74-48a6-45a2-b42d-7181287af475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dab3e74-48a6-45a2-b42d-7181287af475', 'volume_size': 1} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Created reservations ['f78b34ba-968b-41a6-b86f-d61a60987bd7', '569ae65b-f029-4e66-9b59-6bc3ff4be225', '80c64ec7-1fce-448e-9275-fa3bc1ed6e9d', 'b2754d3a-6651-4214-ab00-d0685d1be103'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Delete snapshot completed successfully. Jul 08 16:28:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-68f4d629-deee-4688-910d-0cbf9ef6cd88 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-ed2eb117-9231-42c4-b624-ac3a48a63c66-delete_snapshot" released by "delete_snapshot" :: held 8.123s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:06 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645" returned: 0 in 7.456s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:06 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf438c-b3e9-4e8b-b2d3-f31962265a4e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:06 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:28:06 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:07 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 1.144s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:07 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:28:07 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Converted 1024.00 MB image at 137.27 MB/s Jul 08 16:28:07 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 is being set with open permissions: ugo+rw Jul 08 16:28:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:07 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 Jul 08 16:28:07 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:08 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645" returned: 0 in 0.719s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" released by "_copy_volume_from_snapshot" :: held 11.832s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb-ce174fe7-1ce9-4527-9713-3e19b38a7645" released by "_create_volume_from_snapshot" :: held 11.869s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.895s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94437268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dab3e74-48a6-45a2-b42d-7181287af475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e8f586e8c6404c8f0e941a1bd02335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:05Z,use_quota=True,user_id='2c014089eacc45d8b67b4f80a675656e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Creating volume 5dab3e74-48a6-45a2-b42d-7181287af475 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:08 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:08 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 1073741824 Jul 08 16:28:08 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a1a419-68ec-42bd-9682-1a4e1e91fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce174fe7-1ce9-4527-9713-3e19b38a7645', 'volume_size': 1, 'snapshot_id': '9cfa6803-c27c-42bc-ba45-05225a19ffbb'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed48c637-bda5-4509-b130-58963e050ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Volume volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 (ce174fe7-1ce9-4527-9713-3e19b38a7645): created successfully Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed48c637-bda5-4509-b130-58963e050ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Flow 'volume_create_manager' (309e5aca-e24e-4e5d-980a-e70e71d597cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-46b4fe2a-700a-4a61-b691-e187a2b72e17 tempest-VolumeDependencyTests-527651841 None] Created volume successfully. Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-9cfa6803-c27c-42bc-ba45-05225a19ffbb-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-9cfa6803-c27c-42bc-ba45-05225a19ffbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Deleting offline snapshot 9cfa6803-c27c-42bc-ba45-05225a19ffbb of volume 5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] snapshot_file for this snap is: volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcdc042-f2bb-49f0-bb40-badd19b5accf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:09 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:28:09 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:09 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 1073741824" returned: 0 in 1.064s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:09 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 Jul 08 16:28:09 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:10 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475" returned: 0 in 0.790s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.511s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=110,cinder:SELECT=88,cinder:DELETE=9,cinder:INSERT=34 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66b41aa-cd9e-49b5-a485-d125b01243ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dab3e74-48a6-45a2-b42d-7181287af475', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520b9651-fe38-4767-ada3-d9519411089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Creating offline snapshot 8d135a99-8870-4a03-a3b7-f280e0156559 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:28:10 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 1.148s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea63b6c-3619-4d8e-bac2-43f899806d48]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ceda8a-3964-4f9b-9e4e-160bede41366]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:10 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Volume volume-5dab3e74-48a6-45a2-b42d-7181287af475 (5dab3e74-48a6-45a2-b42d-7181287af475): created successfully Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520b9651-fe38-4767-ada3-d9519411089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Flow 'volume_create_manager' (5981dca5-00fd-43dc-9036-f352e11c4bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5ba4e175-5bd2-49ea-944b-699abf630f9b tempest-ProjectReaderTests-1565636117 None] Created volume successfully. Jul 08 16:28:10 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:28:10 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:10 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:28:10 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "cinder-5dab3e74-48a6-45a2-b42d-7181287af475-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-5dab3e74-48a6-45a2-b42d-7181287af475-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "cinder-quobyte-5dab3e74-48a6-45a2-b42d-7181287af475" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-quobyte-5dab3e74-48a6-45a2-b42d-7181287af475" acquired by "delete_volume" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[67209f2d-16cd-459b-ab43-1c25abcb6ef2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:11 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 Jul 08 16:28:11 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:11 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 1.094s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:11 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:28:11 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:11 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.342s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:11 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 1G Jul 08 16:28:11 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Flow 'volume_create_manager' (1d816fa8-d2de-452f-b101-fabc70c419c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91445d78-e753-4e63-9a6b-a30ccb376e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91445d78-e753-4e63-9a6b-a30ccb376e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-349751546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e12c42-7af3-4856-8386-2d5e5c56c1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ebabc83a6b40088497ad993ca8f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:12Z,use_quota=True,user_id='e11d228eea474d9491a4a5e98f19e2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b66d7f-e1ed-4903-9ff4-548b7a8db75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b66d7f-e1ed-4903-9ff4-548b7a8db75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48a249a-bfe8-44ad-894b-cf8e4c1de470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48a249a-bfe8-44ad-894b-cf8e4c1de470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e12c42-7af3-4856-8386-2d5e5c56c1e5', 'volume_name': 'volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dbf989-eb26-4e78-9cab-e109a4fbf7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dbf989-eb26-4e78-9cab-e109a4fbf7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775b40ff-66cc-44c2-bb96-4befe884291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:11 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Volume 41e12c42-7af3-4856-8386-2d5e5c56c1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5', 'volume_size': 1} Jul 08 16:28:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:12 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475" returned: 0 in 1.243s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:12 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475 Jul 08 16:28:12 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:12 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 0.949s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:12 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb Jul 08 16:28:12 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:12 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 1G" returned: 0 in 1.108s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:12 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 Jul 08 16:28:12 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:13 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dab3e74-48a6-45a2-b42d-7181287af475" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-quobyte-5dab3e74-48a6-45a2-b42d-7181287af475" released by "delete_volume" :: held 2.051s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Created reservations ['0552f080-8de3-4560-9b1b-b0371562915b', 'fddc639d-d8b7-4dc0-a54e-f8b0e009e49f', '05167cda-52c5-4558-a566-6533e80c23ff', 'c18cb900-60fb-40e6-a349-7f7804d30adf'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:13 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0.9cfa6803-c27c-42bc-ba45-05225a19ffbb" returned: 0 in 0.738s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-9cfa6803-c27c-42bc-ba45-05225a19ffbb" released by "_delete_snapshot" :: held 4.083s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" released by "delete_snapshot" :: held 4.113s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:13 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:13 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Created reservations ['7823af6e-cbba-4471-8df0-3d640b59c5cd', '1be5154f-9782-46a8-b0af-53f19755ef7d', 'ac6cd2bc-b53f-45d4-aa25-de454c667020', '9d639514-8414-4fa4-b29a-21ceb7b31b97'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Delete snapshot completed successfully. Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f5e6a924-6180-4049-a88b-a27e8da62684 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-9cfa6803-c27c-42bc-ba45-05225a19ffbb-delete_snapshot" released by "delete_snapshot" :: held 4.372s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:13 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559" returned: 0 in 0.882s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:13 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 is being set with open permissions: ugo+rw Jul 08 16:28:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:13 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 Jul 08 16:28:13 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:14 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.745s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Deleted volume successfully. Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b9f9525f-5a84-41e0-a1ff-587ff11f3d83 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-5dab3e74-48a6-45a2-b42d-7181287af475-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:14 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.173s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-349751546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e12c42-7af3-4856-8386-2d5e5c56c1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ebabc83a6b40088497ad993ca8f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:12Z,use_quota=True,user_id='e11d228eea474d9491a4a5e98f19e2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Creating volume 41e12c42-7af3-4856-8386-2d5e5c56c1e5 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:14 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-5f6f6861-6b82-4bba-8eac-e09845cda1d0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:14 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 1073741824 Jul 08 16:28:14 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-5f6f6861-6b82-4bba-8eac-e09845cda1d0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-351bf975-48b7-49a7-ab85-c0b7afb47422 tempest-SnapshotsActionsTest-1565240630 None] Create snapshot completed successfully Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175d50f-ea98-4475-a3e3-f68232ffa74f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:14 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:28:14 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Flow 'volume_create_manager' (1c97dc21-83ae-4c20-a340-5b5173d3d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a9c62-896a-4d1b-9edb-b981018eac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a9c62-896a-4d1b-9edb-b981018eac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908547749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96bb27c-27aa-45b3-acc0-55953eaa205a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e8f586e8c6404c8f0e941a1bd02335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:15Z,use_quota=True,user_id='2c014089eacc45d8b67b4f80a675656e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb0c49f-b3a3-4c9c-b5ef-845c668bfc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb0c49f-b3a3-4c9c-b5ef-845c668bfc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa2283e-8330-4d7c-a753-29f46088ea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa2283e-8330-4d7c-a753-29f46088ea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96bb27c-27aa-45b3-acc0-55953eaa205a', 'volume_name': 'volume-e96bb27c-27aa-45b3-acc0-55953eaa205a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8876be-a557-48e6-9819-979f1de102e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8876be-a557-48e6-9819-979f1de102e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cb3cee-518d-4ba0-a0d3-584374fc96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Volume e96bb27c-27aa-45b3-acc0-55953eaa205a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96bb27c-27aa-45b3-acc0-55953eaa205a', 'volume_size': 1} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-8d135a99-8870-4a03-a3b7-f280e0156559-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-8d135a99-8870-4a03-a3b7-f280e0156559-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Acquiring lock "cinder-quobyte-8d135a99-8870-4a03-a3b7-f280e0156559" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-8d135a99-8870-4a03-a3b7-f280e0156559" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Deleting offline snapshot 8d135a99-8870-4a03-a3b7-f280e0156559 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] snapshot_file for this snap is: volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bb9c9-bdf8-4d09-a8a8-dcc623306b4a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:15 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 Jul 08 16:28:15 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:15 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 1.017s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:15 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0 Jul 08 16:28:15 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:15 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 1073741824" returned: 0 in 1.428s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:16 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 Jul 08 16:28:16 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:16 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559" returned: 0 in 0.948s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163fdee-5142-473f-bd0f-096c65dfb91f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:16 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5f6f6861-6b82-4bba-8eac-e09845cda1d0" returned: 0 in 0.900s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-5f6f6861-6b82-4bba-8eac-e09845cda1d0" released by "delete_volume" :: held 1.978s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:16 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:28:16 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Created reservations ['17f5c11b-c2f0-47fc-b8f7-0e0fe04d49b1', '06442f8d-d5b4-49ec-9101-a9b20661cee2', 'd321e6e0-de8a-4d7b-b6f4-dd606a1c95aa', '3560bfed-c68f-47cd-8d87-c515c7c1b418'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:16 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:16 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:16 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5" returned: 0 in 0.887s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.784s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908547749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96bb27c-27aa-45b3-acc0-55953eaa205a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e8f586e8c6404c8f0e941a1bd02335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:15Z,use_quota=True,user_id='2c014089eacc45d8b67b4f80a675656e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Creating volume e96bb27c-27aa-45b3-acc0-55953eaa205a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:16 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:16 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a 1073741824 Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775b40ff-66cc-44c2-bb96-4befe884291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:16 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c88a89-88ea-4bf0-9a9c-7ceb9496df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Volume volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 (41e12c42-7af3-4856-8386-2d5e5c56c1e5): created successfully Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c88a89-88ea-4bf0-9a9c-7ceb9496df6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Flow 'volume_create_manager' (1d816fa8-d2de-452f-b101-fabc70c419c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5be439d9-6beb-4729-aa5e-d2651ae5895a tempest-TestMinimumBasicScenario-439153264 None] Created volume successfully. Jul 08 16:28:17 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.075s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:17 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:17 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:17 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Deleted volume successfully. Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c34a7ad0-d52a-4b2a-bb9d-ce34b4f44646 tempest-VolumeDependencyTests-527651841 None] Lock "cinder-5f6f6861-6b82-4bba-8eac-e09845cda1d0-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-ce174fe7-1ce9-4527-9713-3e19b38a7645-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "cinder-ce174fe7-1ce9-4527-9713-3e19b38a7645-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Acquiring lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4dac53-190c-455e-b9e3-c831c38e5e6f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:18 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a 1073741824" returned: 0 in 1.172s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:18 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a Jul 08 16:28:18 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:18 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 Jul 08 16:28:18 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:18 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559" returned: 0 in 1.138s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:18 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559 Jul 08 16:28:18 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:19 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a" returned: 0 in 0.935s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cb3cee-518d-4ba0-a0d3-584374fc96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96bb27c-27aa-45b3-acc0-55953eaa205a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0495be-ba65-441b-867f-a7921b5d687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:19 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645" returned: 0 in 1.112s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:19 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Volume volume-e96bb27c-27aa-45b3-acc0-55953eaa205a (e96bb27c-27aa-45b3-acc0-55953eaa205a): created successfully Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0495be-ba65-441b-867f-a7921b5d687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Flow 'volume_create_manager' (1c97dc21-83ae-4c20-a340-5b5173d3d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f36c61a2-9b65-459e-9ee8-dddeca1968ca tempest-ProjectReaderTests-1565636117 None] Created volume successfully. Jul 08 16:28:19 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645 Jul 08 16:28:19 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:19 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:19 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "cinder-e96bb27c-27aa-45b3-acc0-55953eaa205a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-e96bb27c-27aa-45b3-acc0-55953eaa205a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "cinder-quobyte-e96bb27c-27aa-45b3-acc0-55953eaa205a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:19 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.8d135a99-8870-4a03-a3b7-f280e0156559" returned: 0 in 0.999s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-quobyte-e96bb27c-27aa-45b3-acc0-55953eaa205a" acquired by "delete_volume" :: waited 0.045s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60f8b3-439b-4c96-8bca-d7d4d320ceb2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-8d135a99-8870-4a03-a3b7-f280e0156559" released by "_delete_snapshot" :: held 4.328s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_snapshot" :: held 4.361s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:19 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a Jul 08 16:28:19 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:19 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Created reservations ['33de5aaa-a329-4d78-b070-77bf494e6377', 'd9115417-0e3d-435c-b64c-22140c02002d', '2e8fc3bb-9507-4b13-9aeb-37268eda9f6e', '6cd0a195-ad93-402a-a150-c463c2d34a0a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Delete snapshot completed successfully. Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-78600470-41fa-47b7-a4d3-f27ab789ce61 tempest-SnapshotsActionsTest-1978948278 None] Lock "cinder-8d135a99-8870-4a03-a3b7-f280e0156559-delete_snapshot" released by "delete_snapshot" :: held 4.716s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:20 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce174fe7-1ce9-4527-9713-3e19b38a7645" returned: 0 in 1.177s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "cinder-quobyte-ce174fe7-1ce9-4527-9713-3e19b38a7645" released by "delete_volume" :: held 2.356s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:20 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Created reservations ['68fca2b6-5706-46bc-bba9-d5916ebc7516', '7feb2153-5e1b-4d55-95e2-d373e70f2467', 'a90c4ff3-7bd0-48c1-863a-148420d0df1d', 'b7dfbc73-773b-4957-9f42-a69b59f2e987'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:20 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:20 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:20 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a" returned: 0 in 0.888s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:20 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a Jul 08 16:28:20 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:21 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.748s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Deleted volume successfully. Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "cinder-154af7d1-f28c-4410-9884-840df89ec780-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-36480956-a1aa-40c1-af47-31eb557228fd tempest-VolumeDependencyTests-527651841 None] Lock "cinder-ce174fe7-1ce9-4527-9713-3e19b38a7645-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-154af7d1-f28c-4410-9884-840df89ec780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "cinder-quobyte-154af7d1-f28c-4410-9884-840df89ec780" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-154af7d1-f28c-4410-9884-840df89ec780" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Deleting offline snapshot 154af7d1-f28c-4410-9884-840df89ec780 of volume 2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] snapshot_file for this snap is: volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f86382-3dee-457d-bfb7-3c5edce31976]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:21 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e96bb27c-27aa-45b3-acc0-55953eaa205a" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-quobyte-e96bb27c-27aa-45b3-acc0-55953eaa205a" released by "delete_volume" :: held 1.785s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:21 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:28:21 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Created reservations ['9fc3acfb-aca5-4829-a2b1-3ed3911881f4', '1511c7ca-128d-4272-a191-9994d35a3430', 'eea05253-d766-4392-b081-f8bf5c63f6af', '202c0ee5-d67b-4881-b510-0cf934c49c61'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:21 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:21 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344692f-731d-4536-a52d-bfd4c044a674]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:22 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 1.007s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e47736f-37c8-4b0a-ade9-6b984862cf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b602c-2ecb-4539-ab44-fa764d296b3b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:22 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Deleted volume successfully. Jul 08 16:28:22 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 Jul 08 16:28:22 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a7d5a720-7a52-4024-8f3e-3542214dec94 tempest-ProjectReaderTests-1565636117 None] Lock "cinder-e96bb27c-27aa-45b3-acc0-55953eaa205a-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:22 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 Jul 08 16:28:22 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:23 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5" returned: 0 in 1.025s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc2054b3-0bbc-444f-bdd3-082fc6793772', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:28:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-a5f24f41-73fe-47fb-b926-2459bd3792a8 req-65e883d7-dfd0-4139-b82f-1473e78f6dba tempest-TestMinimumBasicScenario-439153264 None] attachment_update completed successfully. Jul 08 16:28:23 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50" returned: 0 in 1.055s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:23 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:28:23 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:24 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:24 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780 Jul 08 16:28:24 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:25 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50.154af7d1-f28c-4410-9884-840df89ec780" returned: 0 in 0.794s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-154af7d1-f28c-4410-9884-840df89ec780" released by "_delete_snapshot" :: held 3.917s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_snapshot" :: held 3.961s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Created reservations ['7fa49aa6-5e37-4452-8ac3-e6377c508e10', '04cfd0b0-bab8-4f46-a70a-122cc6422f9f', '932af948-aa33-4ec7-9d18-1dd087c6f677', '7de338e5-43fd-4fc4-8b92-c5ab9370e167'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Delete snapshot completed successfully. Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d1ce3500-d02c-4952-a86a-ce02042ea09e tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-154af7d1-f28c-4410-9884-840df89ec780-delete_snapshot" released by "delete_snapshot" :: held 4.140s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "cinder-2e47736f-37c8-4b0a-ade9-6b984862cf50-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-2e47736f-37c8-4b0a-ade9-6b984862cf50-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e9a18-b45a-458d-bad6-5aaee079e4ba]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:26 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 Jul 08 16:28:26 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (9a50476d-975c-4f75-a548-e780526d4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8489bd78-64bc-49d7-adc5-854f766d6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8489bd78-64bc-49d7-adc5-854f766d6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236929238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7ab0f-37f5-4767-918f-4a8bf98a859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:26Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbdabd6-f26f-4e9f-acaa-e8a0dda5cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbdabd6-f26f-4e9f-acaa-e8a0dda5cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c036b0b-16ce-4cc2-9a8e-ef3fe0f35c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c036b0b-16ce-4cc2-9a8e-ef3fe0f35c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b7ab0f-37f5-4767-918f-4a8bf98a859f', 'volume_name': 'volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b31cd06-120f-4cd4-b9e3-c2dd51857384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b31cd06-120f-4cd4-b9e3-c2dd51857384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef19a75b-3309-4715-a25b-6e4e3dba7a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:26 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Volume b6b7ab0f-37f5-4767-918f-4a8bf98a859f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f', 'volume_size': 1} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236929238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7ab0f-37f5-4767-918f-4a8bf98a859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:26Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Creating volume b6b7ab0f-37f5-4767-918f-4a8bf98a859f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:26 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:26 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f 1073741824 Jul 08 16:28:26 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:27 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50" returned: 0 in 1.083s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:27 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50 Jul 08 16:28:27 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:27 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f 1073741824" returned: 0 in 1.322s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:27 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f Jul 08 16:28:27 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:28 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-2e47736f-37c8-4b0a-ade9-6b984862cf50" returned: 0 in 1.058s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-quobyte-2e47736f-37c8-4b0a-ade9-6b984862cf50" released by "delete_volume" :: held 2.270s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Created reservations ['44b079a5-0529-4d17-bcf8-d9df39fc7648', '4677c7a9-6908-40ed-848d-dad6a3180834', '2ae9d448-4f9a-4cac-91af-5ab713d2872a', 'fd15c9cb-bf56-4b57-813b-8524feb798ad'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:28 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:28 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:28 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" returned: 0 in 1.120s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef19a75b-3309-4715-a25b-6e4e3dba7a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4cd08-bac7-48eb-a050-ab1d96b0b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:28 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Volume volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f (b6b7ab0f-37f5-4767-918f-4a8bf98a859f): created successfully Jul 08 16:28:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4cd08-bac7-48eb-a050-ab1d96b0b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (9a50476d-975c-4f75-a548-e780526d4482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5af751e0-f02a-44df-8cc2-ee89f6c25b34 tempest-ProjectReaderTests-1316017790 None] Created volume successfully. Jul 08 16:28:29 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.921s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:29 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Deleted volume successfully. Jul 08 16:28:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ff38b712-9243-48b0-8489-7c639f31f5c1 tempest-SnapshotsActionsTest-1565240630 None] Lock "cinder-2e47736f-37c8-4b0a-ade9-6b984862cf50-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-b6b7ab0f-37f5-4767-918f-4a8bf98a859f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "cinder-b6b7ab0f-37f5-4767-918f-4a8bf98a859f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-quobyte-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b8c9c-a732-40e7-a1d3-ea6b285f1e64]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:30 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f Jul 08 16:28:30 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:31 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" returned: 0 in 1.092s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:31 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f Jul 08 16:28:31 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:32 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" returned: 0 in 0.896s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-b6b7ab0f-37f5-4767-918f-4a8bf98a859f" released by "delete_volume" :: held 2.062s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Created reservations ['7ed94049-75a9-416e-9135-bf454f15a9c3', '7d9d230f-8358-43b1-a5ae-db56f6efe9c4', '390d63a7-c248-4bac-8519-4c0f8cd09ae7', '90596c09-4aa0-4dac-a9b2-e538fb33ade1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:32 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:32 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:33 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.111s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:33 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Deleted volume successfully. Jul 08 16:28:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e00d7b40-fef2-41c7-960b-33e26f5a8c6a tempest-ProjectReaderTests-1316017790 None] Lock "cinder-b6b7ab0f-37f5-4767-918f-4a8bf98a859f-delete_volume" released by "delete_volume" :: held 3.633s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (475c556e-cb57-4b01-8aec-b1f9c19555df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010516d9-11c7-4940-998f-c9bdbb699807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010516d9-11c7-4940-998f-c9bdbb699807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455843066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a58177f-e0b4-40f1-a299-54173d4fbf6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:34Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1562bc-1de1-4e3e-b918-1df56675327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1562bc-1de1-4e3e-b918-1df56675327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374b8774-3a7e-4c6a-9505-4e16af68d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374b8774-3a7e-4c6a-9505-4e16af68d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a58177f-e0b4-40f1-a299-54173d4fbf6e', 'volume_name': 'volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e1253c-fcfe-4082-af6a-3c2ab13a3df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e1253c-fcfe-4082-af6a-3c2ab13a3df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bff63e3-7430-4955-a346-abc523024fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Volume 1a58177f-e0b4-40f1-a299-54173d4fbf6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e', 'volume_size': 1} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455843066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a58177f-e0b4-40f1-a299-54173d4fbf6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:34Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Creating volume 1a58177f-e0b4-40f1-a299-54173d4fbf6e {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:34 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:34 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e 1073741824 Jul 08 16:28:34 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:35 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e 1073741824" returned: 0 in 1.255s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:35 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e Jul 08 16:28:35 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:36 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e" returned: 0 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bff63e3-7430-4955-a346-abc523024fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f758585a-516a-4aed-ba88-30f75c9df6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:36 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Volume volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e (1a58177f-e0b4-40f1-a299-54173d4fbf6e): created successfully Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f758585a-516a-4aed-ba88-30f75c9df6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (475c556e-cb57-4b01-8aec-b1f9c19555df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:36 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7d5b83f6-17e7-4f04-a4c0-d35dd3fea6ac tempest-ProjectReaderTests-1316017790 None] Created volume successfully. Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-1a58177f-e0b4-40f1-a299-54173d4fbf6e-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-1a58177f-e0b4-40f1-a299-54173d4fbf6e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-quobyte-1a58177f-e0b4-40f1-a299-54173d4fbf6e" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-1a58177f-e0b4-40f1-a299-54173d4fbf6e" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d0a60e-7520-46b1-b28f-94aea65a833f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:37 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e Jul 08 16:28:37 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:38 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e" returned: 0 in 0.968s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:38 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e Jul 08 16:28:38 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:39 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1a58177f-e0b4-40f1-a299-54173d4fbf6e" returned: 0 in 0.729s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-1a58177f-e0b4-40f1-a299-54173d4fbf6e" released by "delete_volume" :: held 1.765s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Created reservations ['2231b42c-c75f-451f-b3cc-20601592d462', '7bf0336a-acc8-41fd-9d05-11881a4b5cf1', '287ba95d-ea6c-4651-92f5-05606700a039', '9c6846fd-6abc-4581-bf94-b5d6c84507f9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:39 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:39 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:40 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Deleted volume successfully. Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-82b08e7e-8c1a-475e-a40b-b3f26cf10544 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-1a58177f-e0b4-40f1-a299-54173d4fbf6e-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (8fda847f-fc5c-4ce3-90dc-1455c1fc2cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a69d87-a839-4091-bb53-c3a3f4a02109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a69d87-a839-4091-bb53-c3a3f4a02109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707712191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21e3c54-6d60-48db-a860-6accb6566673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:40Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13505331-552f-4e3f-a598-c5efad4ef1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13505331-552f-4e3f-a598-c5efad4ef1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f1e05b-29c3-43ab-b015-bbd996fee99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f1e05b-29c3-43ab-b015-bbd996fee99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21e3c54-6d60-48db-a860-6accb6566673', 'volume_name': 'volume-e21e3c54-6d60-48db-a860-6accb6566673', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8f150b-5711-4912-828c-e9bba9bc57e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8f150b-5711-4912-828c-e9bba9bc57e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e0aa66-2d2d-4792-86ff-c542f84a2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:40 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Volume e21e3c54-6d60-48db-a860-6accb6566673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21e3c54-6d60-48db-a860-6accb6566673', 'volume_size': 1} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707712191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21e3c54-6d60-48db-a860-6accb6566673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:40Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Creating volume e21e3c54-6d60-48db-a860-6accb6566673 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:40 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:40 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 1073741824 Jul 08 16:28:40 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:41 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 1073741824" returned: 0 in 1.088s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:41 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 Jul 08 16:28:41 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:42 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673" returned: 0 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e0aa66-2d2d-4792-86ff-c542f84a2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21e3c54-6d60-48db-a860-6accb6566673', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c926f39f-3084-4b8e-8148-d3ba5f70d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Volume volume-e21e3c54-6d60-48db-a860-6accb6566673 (e21e3c54-6d60-48db-a860-6accb6566673): created successfully Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c926f39f-3084-4b8e-8148-d3ba5f70d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (8fda847f-fc5c-4ce3-90dc-1455c1fc2cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e57f1da8-2551-4800-b688-ef76a289bc83 tempest-ProjectReaderTests-1316017790 None] Created volume successfully. Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-e21e3c54-6d60-48db-a860-6accb6566673-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "cinder-e21e3c54-6d60-48db-a860-6accb6566673-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-quobyte-e21e3c54-6d60-48db-a860-6accb6566673" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-e21e3c54-6d60-48db-a860-6accb6566673" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f481f-bd90-4185-8e4d-f4fe45b4e602]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:43 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 Jul 08 16:28:43 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:44 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673" returned: 0 in 1.030s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:44 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673 Jul 08 16:28:44 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:45 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e21e3c54-6d60-48db-a860-6accb6566673" returned: 0 in 0.826s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-e21e3c54-6d60-48db-a860-6accb6566673" released by "delete_volume" :: held 1.910s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=99,cinder:INSERT=30,cinder:UPDATE=125,cinder:DELETE=10 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Created reservations ['fd546e12-6e17-4884-821f-f7edf7e5b5de', '8f5d2d4d-dc3f-4f4f-8016-09b0873ba303', '55716b91-1f4a-4f4e-8590-8720ed8a715f', '5232e094-c273-4bc6-b195-f3cadc9839ba'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:45 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:45 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Flow 'volume_create_manager' (667756bf-fea2-4a68-b607-9fc90bfe5419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b94c88a-5f97-451c-8b29-4893339dfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b94c88a-5f97-451c-8b29-4893339dfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1120831695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413bfd77-c3fa-44ef-9555-2599467280e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d89fde51e34f55af5251e862457087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:46Z,use_quota=True,user_id='6a5d0ea82ca5409f81c5d67add2ea6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f618025-f22b-4f77-9937-120050eae590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f618025-f22b-4f77-9937-120050eae590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a547f193-415c-413a-b8ab-d6767e6d10ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a547f193-415c-413a-b8ab-d6767e6d10ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413bfd77-c3fa-44ef-9555-2599467280e3', 'volume_name': 'volume-413bfd77-c3fa-44ef-9555-2599467280e3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea387ce-bb57-42a8-b4c2-f89049d77871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea387ce-bb57-42a8-b4c2-f89049d77871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23648bd1-2edc-4050-96dd-0078f6c493b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume 413bfd77-c3fa-44ef-9555-2599467280e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413bfd77-c3fa-44ef-9555-2599467280e3', 'volume_size': 1} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1120831695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413bfd77-c3fa-44ef-9555-2599467280e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d89fde51e34f55af5251e862457087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:46Z,use_quota=True,user_id='6a5d0ea82ca5409f81c5d67add2ea6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Creating volume 413bfd77-c3fa-44ef-9555-2599467280e3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:46 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:46 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 1073741824 Jul 08 16:28:46 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (85402efd-be6b-4a8a-b578-7064d3f50251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7775848-8b8c-46f5-aefd-29d3b67e0ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7775848-8b8c-46f5-aefd-29d3b67e0ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875091947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2d0f96-9016-485e-a394-7572c678304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:46Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af49661-292f-4e1b-b395-6010b702af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af49661-292f-4e1b-b395-6010b702af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f8394c-7b19-46cb-8bb9-7a33727a3c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f8394c-7b19-46cb-8bb9-7a33727a3c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2d0f96-9016-485e-a394-7572c678304a', 'volume_name': 'volume-5b2d0f96-9016-485e-a394-7572c678304a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402a16b3-cdfb-4a21-bf9f-841293b0de38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402a16b3-cdfb-4a21-bf9f-841293b0de38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f02bfe-b83c-48ff-8d89-96de5da0d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Volume 5b2d0f96-9016-485e-a394-7572c678304a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2d0f96-9016-485e-a394-7572c678304a', 'volume_size': 1} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:46 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.998s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Deleted volume successfully. Jul 08 16:28:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d310d40b-b6f8-4cd1-a78e-765fbafd678b tempest-ProjectReaderTests-1316017790 None] Lock "cinder-e21e3c54-6d60-48db-a860-6accb6566673-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:47 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 1073741824" returned: 0 in 1.106s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:47 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 Jul 08 16:28:47 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:48 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3" returned: 0 in 0.709s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875091947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2d0f96-9016-485e-a394-7572c678304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27f52ab43254e13b7ab0894ad5ef3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:46Z,use_quota=True,user_id='ba66d69531954a7e950f89fe4bd31379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Creating volume 5b2d0f96-9016-485e-a394-7572c678304a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:48 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23648bd1-2edc-4050-96dd-0078f6c493b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413bfd77-c3fa-44ef-9555-2599467280e3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43830d8-336f-40cf-aa28-3311644c3935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:48 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a 1073741824 Jul 08 16:28:48 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:48 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume volume-413bfd77-c3fa-44ef-9555-2599467280e3 (413bfd77-c3fa-44ef-9555-2599467280e3): created successfully Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43830d8-336f-40cf-aa28-3311644c3935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Flow 'volume_create_manager' (667756bf-fea2-4a68-b607-9fc90bfe5419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8886fafe-4bf1-42c8-9daa-0a451a72770e tempest-VolumeQuotasAdminTestJSON-286271953 None] Created volume successfully. Jul 08 16:28:49 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a 1073741824" returned: 0 in 0.906s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:49 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a Jul 08 16:28:49 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "cinder-413bfd77-c3fa-44ef-9555-2599467280e3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "cinder-413bfd77-c3fa-44ef-9555-2599467280e3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "cinder-quobyte-413bfd77-c3fa-44ef-9555-2599467280e3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "cinder-quobyte-413bfd77-c3fa-44ef-9555-2599467280e3" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd317259-7db4-4ca5-a97f-ecdf700f7ed4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:49 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 Jul 08 16:28:49 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:50 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a" returned: 0 in 0.954s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f02bfe-b83c-48ff-8d89-96de5da0d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2d0f96-9016-485e-a394-7572c678304a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c7fde-5d38-4037-870f-769152db2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Volume volume-5b2d0f96-9016-485e-a394-7572c678304a (5b2d0f96-9016-485e-a394-7572c678304a): created successfully Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c7fde-5d38-4037-870f-769152db2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Flow 'volume_create_manager' (85402efd-be6b-4a8a-b578-7064d3f50251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f8bf14ba-db1b-4516-8819-45942001ff98 tempest-ProjectReaderTests-1316017790 None] Created volume successfully. Jul 08 16:28:50 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3" returned: 0 in 0.891s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:50 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3 Jul 08 16:28:50 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-5b2d0f96-9016-485e-a394-7572c678304a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-5b2d0f96-9016-485e-a394-7572c678304a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "cinder-quobyte-5b2d0f96-9016-485e-a394-7572c678304a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-5b2d0f96-9016-485e-a394-7572c678304a" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe476365-9960-460a-9abe-6c210c285f31]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:51 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a Jul 08 16:28:51 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:51 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-413bfd77-c3fa-44ef-9555-2599467280e3" returned: 0 in 1.158s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "cinder-quobyte-413bfd77-c3fa-44ef-9555-2599467280e3" released by "delete_volume" :: held 2.122s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Created reservations ['425792da-193a-444f-a96c-87e42a68bbb4', '4fcaa8bb-0df9-4d2d-b79d-6605dd1afd9c', 'b7e8a88d-5f98-43c3-94a2-f9ec7d75d83f', '8404e145-a453-443f-a8d7-91c8c8fd5f77'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:51 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:51 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:52 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a" returned: 0 in 0.953s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:52 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a Jul 08 16:28:52 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:52 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Deleted volume successfully. Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-05ed1143-d7d6-4bd1-ae06-d799c89f7833 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "cinder-413bfd77-c3fa-44ef-9555-2599467280e3-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:52 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b2d0f96-9016-485e-a394-7572c678304a" returned: 0 in 0.720s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-quobyte-5b2d0f96-9016-485e-a394-7572c678304a" released by "delete_volume" :: held 1.724s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Created reservations ['8a0e06f9-9f24-465d-97bf-40bba06817ff', '94befacb-5aea-4246-baa4-c2168153c0bb', 'f6949cdf-be1e-4a19-a191-ce3e95304a85', '7226ee7b-9621-4755-909d-7728686d1e5b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:53 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:28:53 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Flow 'volume_create_manager' (b5d47cc1-134f-4ef4-9e47-ebcc4515f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2661c063-91b2-4be3-a924-62072e23f94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2661c063-91b2-4be3-a924-62072e23f94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1338692313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7500f0e8-50ce-4187-8f61-f83bbd9ac293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d89fde51e34f55af5251e862457087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:53Z,use_quota=True,user_id='6a5d0ea82ca5409f81c5d67add2ea6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f16f49b-236a-4a4f-ba34-558dd36bc4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f16f49b-236a-4a4f-ba34-558dd36bc4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c01b0a-592a-40d0-ac5c-bd0f70f9dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c01b0a-592a-40d0-ac5c-bd0f70f9dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7500f0e8-50ce-4187-8f61-f83bbd9ac293', 'volume_name': 'volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6e9c8d-9996-4359-9cc7-3aabbd2fcb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6e9c8d-9996-4359-9cc7-3aabbd2fcb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b49de4-42a1-4705-a4f5-2532861b0bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:53 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume 7500f0e8-50ce-4187-8f61-f83bbd9ac293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293', 'volume_size': 1} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1338692313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7500f0e8-50ce-4187-8f61-f83bbd9ac293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d89fde51e34f55af5251e862457087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:28:53Z,use_quota=True,user_id='6a5d0ea82ca5409f81c5d67add2ea6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Creating volume 7500f0e8-50ce-4187-8f61-f83bbd9ac293 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:28:53 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:28:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:53 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 1073741824 Jul 08 16:28:53 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:54 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.135s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:54 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:28:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Deleted volume successfully. Jul 08 16:28:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6a7699b6-1a2a-4319-80a6-c5b5e63a83e9 tempest-ProjectReaderTests-1316017790 None] Lock "cinder-5b2d0f96-9016-485e-a394-7572c678304a-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:28:55 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 1073741824" returned: 0 in 1.457s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:55 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 Jul 08 16:28:55 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:56 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293" returned: 0 in 0.886s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b49de4-42a1-4705-a4f5-2532861b0bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32832eb1-ed99-429f-8245-8b34f4e1a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:28:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Volume volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 (7500f0e8-50ce-4187-8f61-f83bbd9ac293): created successfully Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32832eb1-ed99-429f-8245-8b34f4e1a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:28:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Flow 'volume_create_manager' (b5d47cc1-134f-4ef4-9e47-ebcc4515f30f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:28:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-aed45a7b-de89-450e-b783-21d8693c23a0 tempest-VolumeQuotasAdminTestJSON-286271953 None] Created volume successfully. Jul 08 16:28:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-aea01ab6-e517-4d48-8732-af77ef36d9df tempest-VolumeQuotasAdminTestJSON-170628367 None] Transfer volume completed successfully. Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Acquiring lock "cinder-7500f0e8-50ce-4187-8f61-f83bbd9ac293-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "cinder-7500f0e8-50ce-4187-8f61-f83bbd9ac293-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Acquiring lock "cinder-quobyte-7500f0e8-50ce-4187-8f61-f83bbd9ac293" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "cinder-quobyte-7500f0e8-50ce-4187-8f61-f83bbd9ac293" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdbee2-d38c-4cdf-905c-e5607a2f8501]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:28:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:58 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 Jul 08 16:28:58 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:28:59 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 08 16:28:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293" returned: 0 in 1.025s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:28:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:28:59 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293 Jul 08 16:28:59 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:00 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7500f0e8-50ce-4187-8f61-f83bbd9ac293" returned: 0 in 0.805s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "cinder-quobyte-7500f0e8-50ce-4187-8f61-f83bbd9ac293" released by "delete_volume" :: held 1.882s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Created reservations ['2bddb677-c7db-41c4-ade7-9f68ea97cc1d', 'ceee0a1b-9a42-47fc-8463-cedf713c06fb', 'e2ec8b21-23e5-4f58-8176-9dda9b1e4eb8', 'd5dcf549-f5bb-4ada-8ded-777ea8a2bdf3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:01 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:01 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:02 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.307s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:02 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Deleted volume successfully. Jul 08 16:29:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-67023850-3b84-47e0-9855-b42122f3d425 tempest-VolumeQuotasAdminTestJSON-198191283 None] Lock "cinder-7500f0e8-50ce-4187-8f61-f83bbd9ac293-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Flow 'volume_create_manager' (cf76e683-2410-404d-aa6c-34f0f9f493d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6983369-f4c7-4572-bcc1-52ae667b0c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6983369-f4c7-4572-bcc1-52ae667b0c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1429102890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6989149e-85d5-41ce-8dcf-3643a52b8376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c5d16b6a1446a2a42755668e6fa870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:06Z,use_quota=True,user_id='91ef876b75814b39b3b2cae206590ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7250ce2-777b-42c3-92bb-e7c2a275dc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7250ce2-777b-42c3-92bb-e7c2a275dc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2b908b-eb73-41de-b434-71f52cd1899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2b908b-eb73-41de-b434-71f52cd1899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6989149e-85d5-41ce-8dcf-3643a52b8376', 'volume_name': 'volume-6989149e-85d5-41ce-8dcf-3643a52b8376', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f26d49-fded-4094-b16a-63feb95ea7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f26d49-fded-4094-b16a-63feb95ea7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8ded4c-265d-45b9-a63f-fc85a6f0efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:06 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Volume 6989149e-85d5-41ce-8dcf-3643a52b8376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6989149e-85d5-41ce-8dcf-3643a52b8376', 'volume_size': 1} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1429102890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6989149e-85d5-41ce-8dcf-3643a52b8376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c5d16b6a1446a2a42755668e6fa870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:06Z,use_quota=True,user_id='91ef876b75814b39b3b2cae206590ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Creating volume 6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:06 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:06 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 1073741824 Jul 08 16:29:06 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:07 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 1073741824" returned: 0 in 0.990s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:07 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:07 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:07 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.763s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8ded4c-265d-45b9-a63f-fc85a6f0efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6989149e-85d5-41ce-8dcf-3643a52b8376', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bdbec2-fa69-4b85-8e3e-fb6b40ce069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Volume volume-6989149e-85d5-41ce-8dcf-3643a52b8376 (6989149e-85d5-41ce-8dcf-3643a52b8376): created successfully Jul 08 16:29:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bdbec2-fa69-4b85-8e3e-fb6b40ce069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Flow 'volume_create_manager' (cf76e683-2410-404d-aa6c-34f0f9f493d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-614b071d-c31e-4a15-b425-d36fa2da1141 tempest-SnapshotDependencyTests-1287606936 None] Created volume successfully. Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Creating offline snapshot 1b644c88-14d9-41b7-b093-80111347a7e8 of volume 6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde059c4-9bb6-477a-8b8d-43d2cfa5bc1a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:09 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:09 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Flow 'volume_create_manager' (c9bd0da3-ed84-476e-9582-342b3efe27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971d094e-f319-402c-9bf2-3791a49da938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971d094e-f319-402c-9bf2-3791a49da938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1590796185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5798c4-3f18-49f8-a95b-727b56bba92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0968cdac7051417492d827af9e451e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:10Z,use_quota=True,user_id='8868bdc072d949998c3a577337d3eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990025d-1b0e-483a-ac98-39970869c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990025d-1b0e-483a-ac98-39970869c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9728e96-0471-4b62-be71-1122272765fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9728e96-0471-4b62-be71-1122272765fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5798c4-3f18-49f8-a95b-727b56bba92b', 'volume_name': 'volume-ce5798c4-3f18-49f8-a95b-727b56bba92b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de9eedc-53e7-44c3-b34c-5cf15d2a3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de9eedc-53e7-44c3-b34c-5cf15d2a3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4af4b83-f8a5-4420-bd87-cd160d42f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:09 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Volume ce5798c4-3f18-49f8-a95b-727b56bba92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5798c4-3f18-49f8-a95b-727b56bba92b', 'volume_size': 1} Jul 08 16:29:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:10 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:10 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 1G Jul 08 16:29:10 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:11 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 1G" returned: 0 in 0.793s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6989149e-85d5-41ce-8dcf-3643a52b8376 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:11 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6989149e-85d5-41ce-8dcf-3643a52b8376 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:11 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:11 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6989149e-85d5-41ce-8dcf-3643a52b8376 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:11 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 is being set with open permissions: ugo+rw Jul 08 16:29:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:11 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:11 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:12 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:12 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=103,cinder:UPDATE=140,cinder:INSERT=35,cinder:DELETE=11 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:29:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:12 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info Jul 08 16:29:12 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:13 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info" returned: 0 in 0.649s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:13 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info is being set with open permissions: ugo+rw Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:13 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info Jul 08 16:29:13 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:13 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.info" returned: 0 in 0.629s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.047s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1590796185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5798c4-3f18-49f8-a95b-727b56bba92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0968cdac7051417492d827af9e451e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:10Z,use_quota=True,user_id='8868bdc072d949998c3a577337d3eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Creating volume ce5798c4-3f18-49f8-a95b-727b56bba92b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:13 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:13 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b 1073741824 Jul 08 16:29:13 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c9350e58-4382-4acc-9882-61acadd269a9 tempest-SnapshotDependencyTests-1287606936 None] Create snapshot completed successfully Jul 08 16:29:14 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b 1073741824" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:14 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b Jul 08 16:29:14 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Flow 'volume_create_manager' (67aac33e-b4ab-4444-a54f-2b94dac9f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808e43ab-ff07-4242-a5ab-ab96551cf59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808e43ab-ff07-4242-a5ab-ab96551cf59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a039f0-2901-4300-aa23-a539ec82ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c5d16b6a1446a2a42755668e6fa870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b644c88-14d9-41b7-b093-80111347a7e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:15Z,use_quota=True,user_id='91ef876b75814b39b3b2cae206590ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b7a0a2-2567-4b99-8c2d-f94634b0beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b7a0a2-2567-4b99-8c2d-f94634b0beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f89aab-6095-4f91-a362-a393a62a2c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f89aab-6095-4f91-a362-a393a62a2c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33a039f0-2901-4300-aa23-a539ec82ed25', 'volume_name': 'volume-33a039f0-2901-4300-aa23-a539ec82ed25', 'volume_size': 1, 'snapshot_id': '1b644c88-14d9-41b7-b093-80111347a7e8'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ebed84-d3e6-468c-82d2-ec8c22077891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ebed84-d3e6-468c-82d2-ec8c22077891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fbce1c-095b-44c2-8cb7-47c901491908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Volume 33a039f0-2901-4300-aa23-a539ec82ed25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33a039f0-2901-4300-aa23-a539ec82ed25', 'volume_size': 1, 'snapshot_id': '1b644c88-14d9-41b7-b093-80111347a7e8'} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b" returned: 0 in 0.795s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8-33a039f0-2901-4300-aa23-a539ec82ed25" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4af4b83-f8a5-4420-bd87-cd160d42f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5798c4-3f18-49f8-a95b-727b56bba92b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7da3d5-f4e1-4276-bb5a-ff25c279e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8-33a039f0-2901-4300-aa23-a539ec82ed25" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Creating volume 33a039f0-2901-4300-aa23-a539ec82ed25 from snapshot 1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Volume volume-ce5798c4-3f18-49f8-a95b-727b56bba92b (ce5798c4-3f18-49f8-a95b-727b56bba92b): created successfully Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7da3d5-f4e1-4276-bb5a-ff25c279e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Flow 'volume_create_manager' (c9bd0da3-ed84-476e-9582-342b3efe27ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] snapshot: 1b644c88-14d9-41b7-b093-80111347a7e8, volume: 33a039f0-2901-4300-aa23-a539ec82ed25, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:29:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e6d511b7-6f7f-4345-ac8d-2bb5a6d7a1b0 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Created volume successfully. Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde9664-9e0d-43fc-a893-4fbdc0e4d85b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:15 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:15 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:16 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6989149e-85d5-41ce-8dcf-3643a52b8376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea695ad-dce1-4b32-a6fb-0f4adbba4e69]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:16 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:16 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Acquiring lock "cinder-ce5798c4-3f18-49f8-a95b-727b56bba92b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "cinder-ce5798c4-3f18-49f8-a95b-727b56bba92b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Acquiring lock "cinder-quobyte-ce5798c4-3f18-49f8-a95b-727b56bba92b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "cinder-quobyte-ce5798c4-3f18-49f8-a95b-727b56bba92b" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135b7e1-665a-4ded-8304-40f60e09c0e2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:17 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b Jul 08 16:29:17 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:17 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:17 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 Jul 08 16:29:17 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:17 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b" returned: 0 in 0.844s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:17 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b Jul 08 16:29:17 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:18 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ce5798c4-3f18-49f8-a95b-727b56bba92b" returned: 0 in 1.047s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "cinder-quobyte-ce5798c4-3f18-49f8-a95b-727b56bba92b" released by "delete_volume" :: held 1.950s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Created reservations ['75c7adb6-4c29-4aef-9dd5-4ab30dc86a7d', '0f4b3ce1-f371-417e-a939-1c0b165950f5', '22c2bf7a-f5b6-4aab-ae6a-fd1a48b12cd7', 'c22531b6-792a-41f9-bdfb-1c3ef9de2886'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:19 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:19 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:19 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:19 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:21 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.819s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:29:21 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 2.272s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Deleted volume successfully. Jul 08 16:29:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba14e06f-bcdf-497b-94cc-3100706f29e7 tempest-VolumeQuotasNegativeTestJSON-1919840448 None] Lock "cinder-ce5798c4-3f18-49f8-a95b-727b56bba92b-delete_volume" released by "delete_volume" :: held 4.582s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:23 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25" returned: 0 in 6.745s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f259f0-6ea2-466c-abae-0c42778e245f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:24 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:24 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:24 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.997s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:24 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:29:24 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Converted 1024.00 MB image at 151.78 MB/s Jul 08 16:29:24 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 is being set with open permissions: ugo+rw Jul 08 16:29:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:25 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 Jul 08 16:29:25 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-3a13debb-78fe-46b9-a95b-1afea01e344e req-37456cc0-6e2a-4ff4-a4a3-5aefd9ae70ca tempest-TestMinimumBasicScenario-439153264 None] Terminate volume connection completed successfully. Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-3a13debb-78fe-46b9-a95b-1afea01e344e req-37456cc0-6e2a-4ff4-a4a3-5aefd9ae70ca tempest-TestMinimumBasicScenario-439153264 None] Deleting attachment bc2054b3-0bbc-444f-bdd3-082fc6793772. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:29:25 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25" returned: 0 in 0.696s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" released by "_copy_volume_from_snapshot" :: held 10.137s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8-33a039f0-2901-4300-aa23-a539ec82ed25" released by "_create_volume_from_snapshot" :: held 10.184s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.215s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fbce1c-095b-44c2-8cb7-47c901491908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a039f0-2901-4300-aa23-a539ec82ed25', 'volume_size': 1, 'snapshot_id': '1b644c88-14d9-41b7-b093-80111347a7e8'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c3a338-6ffb-40b8-a010-1953aca6070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Volume volume-33a039f0-2901-4300-aa23-a539ec82ed25 (33a039f0-2901-4300-aa23-a539ec82ed25): created successfully Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c3a338-6ffb-40b8-a010-1953aca6070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Flow 'volume_create_manager' (67aac33e-b4ab-4444-a54f-2b94dac9f439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-72601424-390a-4674-9a70-02df02a10ab4 tempest-SnapshotDependencyTests-1287606936 None] Created volume successfully. Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-1b644c88-14d9-41b7-b093-80111347a7e8-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-1b644c88-14d9-41b7-b093-80111347a7e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Deleting offline snapshot 1b644c88-14d9-41b7-b093-80111347a7e8 of volume 6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] snapshot_file for this snap is: volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f125990f-1bc4-433e-855c-be88ff8a9eb7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:26 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:26 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "cinder-41e12c42-7af3-4856-8386-2d5e5c56c1e5-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "cinder-41e12c42-7af3-4856-8386-2d5e5c56c1e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "cinder-quobyte-41e12c42-7af3-4856-8386-2d5e5c56c1e5" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "cinder-quobyte-41e12c42-7af3-4856-8386-2d5e5c56c1e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[42691fbe-b10a-4704-b2bc-5bbe672b754e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:27 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.854s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6989149e-85d5-41ce-8dcf-3643a52b8376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:29:27 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 Jul 08 16:29:27 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[50709330-4ca7-4b56-9359-3f7e3f4d189f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:27 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:27 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:28 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5" returned: 0 in 0.818s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:28 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5 Jul 08 16:29:28 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:28 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.897s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:28 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:28 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:28 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-41e12c42-7af3-4856-8386-2d5e5c56c1e5" returned: 0 in 0.738s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "cinder-quobyte-41e12c42-7af3-4856-8386-2d5e5c56c1e5" released by "delete_volume" :: held 1.608s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Created reservations ['e444e12f-308c-4dd6-9ae5-8a6ddd341fb9', '297bcf1c-c806-41f6-addf-a5ab61c59d9c', '1f1bf293-31a9-4201-8aff-5f48ffb48c87', '3d0ed548-460c-46af-8775-2c1a0af9d08d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:29 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:29 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:29 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.904s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:29 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8 Jul 08 16:29:29 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:29 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.765s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:29 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Deleted volume successfully. Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a644c8f9-4973-499c-bd12-b2a35349e46d tempest-TestMinimumBasicScenario-439153264 None] Lock "cinder-41e12c42-7af3-4856-8386-2d5e5c56c1e5-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:30 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376.1b644c88-14d9-41b7-b093-80111347a7e8" returned: 0 in 0.859s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-1b644c88-14d9-41b7-b093-80111347a7e8" released by "_delete_snapshot" :: held 3.618s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" released by "delete_snapshot" :: held 3.641s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Created reservations ['7cee84a4-1ef3-4238-b33c-17330aa5d2d7', '073a2e13-0bd5-4e3d-aae7-5b22ab955916', 'f527bb02-ccf5-4849-bd33-fe810c0f8ac0', '19f3976d-c9ed-4abf-a68a-3d6e646530b6'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Delete snapshot completed successfully. Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-63416487-2b1c-467c-a967-03b3552658b1 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-1b644c88-14d9-41b7-b093-80111347a7e8-delete_snapshot" released by "delete_snapshot" :: held 3.787s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-6989149e-85d5-41ce-8dcf-3643a52b8376-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-6989149e-85d5-41ce-8dcf-3643a52b8376-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83247ac-7355-4c15-975c-800f46c12d4d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:31 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:31 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:31 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.922s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:31 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376 Jul 08 16:29:31 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:32 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6989149e-85d5-41ce-8dcf-3643a52b8376" returned: 0 in 0.797s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-6989149e-85d5-41ce-8dcf-3643a52b8376" released by "delete_volume" :: held 1.799s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Created reservations ['356281db-e533-49ee-9f45-e7dc5990f7ae', '44fb2b3e-d342-4416-b809-2abc7eadf32a', '66f88642-e966-48a0-a2bf-f56039074fea', 'd4b633d8-62c6-478a-99be-fe9a69bd44e5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:32 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:32 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-33a039f0-2901-4300-aa23-a539ec82ed25-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-33a039f0-2901-4300-aa23-a539ec82ed25-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f954351a-2be0-40c2-8352-f935e73757bc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:33 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 Jul 08 16:29:33 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:33 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.730s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Deleted volume successfully. Jul 08 16:29:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-74a54446-9f9d-4574-b5d4-60cffa61d1f7 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-6989149e-85d5-41ce-8dcf-3643a52b8376-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:34 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25" returned: 0 in 0.862s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:34 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25 Jul 08 16:29:34 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:34 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33a039f0-2901-4300-aa23-a539ec82ed25" returned: 0 in 0.701s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-quobyte-33a039f0-2901-4300-aa23-a539ec82ed25" released by "delete_volume" :: held 1.612s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Created reservations ['4d5e398a-336f-410b-891c-2e754a67ec57', '414c636a-e2a4-49b1-88d4-1d26f66a4748', '546d4b56-788c-4adf-b6ed-fdd1e7c39fe0', 'd813e5b7-ec6c-4fba-a066-fe7762245c40'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:35 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:35 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:35 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.725s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Deleted volume successfully. Jul 08 16:29:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c4734228-571d-4dc6-90b4-c769ecc0e942 tempest-SnapshotDependencyTests-1287606936 None] Lock "cinder-33a039f0-2901-4300-aa23-a539ec82ed25-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (a9cb53fe-243d-49f1-89ce-b69366617769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b34173b-b28d-4a1e-b0be-888e9e3b6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b34173b-b28d-4a1e-b0be-888e9e3b6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1969285301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f961cf5-cbe4-4eb4-ab83-7d08c3e35177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:38Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5791f68-3167-42c4-baf0-9daf16173de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5791f68-3167-42c4-baf0-9daf16173de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5039e73-a30a-4bf7-a80f-6c6a0ed3b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5039e73-a30a-4bf7-a80f-6c6a0ed3b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f961cf5-cbe4-4eb4-ab83-7d08c3e35177', 'volume_name': 'volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab766996-e1e6-4dd0-8653-806b57a0e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab766996-e1e6-4dd0-8653-806b57a0e75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8341c9-4696-46b8-9885-b03a7abb3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Volume 1f961cf5-cbe4-4eb4-ab83-7d08c3e35177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177', 'volume_size': 1} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1969285301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f961cf5-cbe4-4eb4-ab83-7d08c3e35177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:38Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Creating volume 1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:38 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:38 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 1073741824 Jul 08 16:29:38 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:39 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 1073741824" returned: 0 in 1.001s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:39 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 Jul 08 16:29:39 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:40 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" returned: 0 in 0.779s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8341c9-4696-46b8-9885-b03a7abb3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e71b1c-3a66-4696-b059-35005c364fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:40 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Volume volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 (1f961cf5-cbe4-4eb4-ab83-7d08c3e35177): created successfully Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e71b1c-3a66-4696-b059-35005c364fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (a9cb53fe-243d-49f1-89ce-b69366617769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:40 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9b5579b6-f98c-4d76-b420-c709d56fbe8d tempest-VolumesListAdminTestJSON-552821517 None] Created volume successfully. Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (3e5b2498-e2b3-4fb0-93b5-615553d2a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f991fdb-0989-4f0d-a520-8c61fe7aded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f991fdb-0989-4f0d-a520-8c61fe7aded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-896281137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b07eaa-dece-4fd0-a745-86f769d686d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:41Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876a357d-a531-4002-9899-8434d7195e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876a357d-a531-4002-9899-8434d7195e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff82d8c-8301-4311-baab-50a08577cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff82d8c-8301-4311-baab-50a08577cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b07eaa-dece-4fd0-a745-86f769d686d1', 'volume_name': 'volume-27b07eaa-dece-4fd0-a745-86f769d686d1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa04d5f-f09c-4363-9379-ea6d0cc8dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa04d5f-f09c-4363-9379-ea6d0cc8dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f6c0a2-77a9-4cc0-b484-7ba7c8c99c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Volume 27b07eaa-dece-4fd0-a745-86f769d686d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b07eaa-dece-4fd0-a745-86f769d686d1', 'volume_size': 1} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-896281137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b07eaa-dece-4fd0-a745-86f769d686d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:41Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Creating volume 27b07eaa-dece-4fd0-a745-86f769d686d1 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:41 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:41 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 1073741824 Jul 08 16:29:41 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:42 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 1073741824" returned: 0 in 1.003s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:42 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 Jul 08 16:29:42 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:43 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f6c0a2-77a9-4cc0-b484-7ba7c8c99c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b07eaa-dece-4fd0-a745-86f769d686d1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1034fb60-ab0e-41d5-abc6-3a4ac52d8ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Volume volume-27b07eaa-dece-4fd0-a745-86f769d686d1 (27b07eaa-dece-4fd0-a745-86f769d686d1): created successfully Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1034fb60-ab0e-41d5-abc6-3a4ac52d8ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (3e5b2498-e2b3-4fb0-93b5-615553d2a61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7b737cbe-209f-4d0c-813d-c3430efc1bb2 tempest-VolumesListAdminTestJSON-552821517 None] Created volume successfully. Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (c36ea074-9d18-4a42-b956-eb6177f28808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86e076-4720-4ce2-a425-b8d17cdd878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86e076-4720-4ce2-a425-b8d17cdd878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1145562470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b92f90-3330-47e0-9da8-c1ed41315eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:45Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be1277-0cb7-4c8c-9fc6-a007cb9bf61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be1277-0cb7-4c8c-9fc6-a007cb9bf61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c8968-939d-446e-9451-f5a33f661810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c8968-939d-446e-9451-f5a33f661810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b92f90-3330-47e0-9da8-c1ed41315eeb', 'volume_name': 'volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f8ad7-acdf-4226-ae27-5c59601f2cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f8ad7-acdf-4226-ae27-5c59601f2cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ee4e0e-2b93-4ae8-930c-2f5e53dc465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Volume b8b92f90-3330-47e0-9da8-c1ed41315eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb', 'volume_size': 1} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1145562470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b92f90-3330-47e0-9da8-c1ed41315eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035de439de4c59b4a2a6bd4601eecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:45Z,use_quota=True,user_id='c6b3eda18cb64ab494977557b088ac0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Creating volume b8b92f90-3330-47e0-9da8-c1ed41315eeb {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:45 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:45 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb 1073741824 Jul 08 16:29:45 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:46 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb 1073741824" returned: 0 in 1.099s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=101,cinder:SELECT=64,cinder:DELETE=11,cinder:INSERT=24 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:46 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb Jul 08 16:29:46 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:46 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb" returned: 0 in 0.677s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ee4e0e-2b93-4ae8-930c-2f5e53dc465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0f26ca-a11b-4ba8-867a-ca890a9be020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Volume volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb (b8b92f90-3330-47e0-9da8-c1ed41315eeb): created successfully Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0f26ca-a11b-4ba8-867a-ca890a9be020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Flow 'volume_create_manager' (c36ea074-9d18-4a42-b956-eb6177f28808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-21d75eba-f6e2-440b-851f-72f2df10b2b0 tempest-VolumesListAdminTestJSON-552821517 None] Created volume successfully. Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Flow 'volume_create_manager' (aab8419c-9c5d-450b-92d5-7c669c8717c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c752ece7-3510-4b5f-885d-9c0c9ad018b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c752ece7-3510-4b5f-885d-9c0c9ad018b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ad7a52-a344-417d-a58b-49fe68fc492a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fff066de71b4d5eb14d0f27cf6940ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:48Z,use_quota=True,user_id='21d6f11673804a09b709fe28b0bb2018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bebac60-b80e-40fe-ba92-a23eaf4b92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bebac60-b80e-40fe-ba92-a23eaf4b92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ca680d-1b62-4073-8cd2-49605e978cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ca680d-1b62-4073-8cd2-49605e978cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ad7a52-a344-417d-a58b-49fe68fc492a', 'volume_name': 'volume-69ad7a52-a344-417d-a58b-49fe68fc492a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794786b7-634d-4e21-9779-b709c7cb3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794786b7-634d-4e21-9779-b709c7cb3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bb779e-0d1a-44b9-8e56-aff35b800f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Volume 69ad7a52-a344-417d-a58b-49fe68fc492a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ad7a52-a344-417d-a58b-49fe68fc492a', 'volume_size': 1} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ad7a52-a344-417d-a58b-49fe68fc492a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fff066de71b4d5eb14d0f27cf6940ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:29:48Z,use_quota=True,user_id='21d6f11673804a09b709fe28b0bb2018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:29:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Creating volume 69ad7a52-a344-417d-a58b-49fe68fc492a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:29:48 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:48 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a 1073741824 Jul 08 16:29:48 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:48 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a 1073741824" returned: 0 in 0.860s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:48 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a Jul 08 16:29:48 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:49 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a" returned: 0 in 0.667s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bb779e-0d1a-44b9-8e56-aff35b800f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ad7a52-a344-417d-a58b-49fe68fc492a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcdae37-a331-447b-9743-d256b0882de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:29:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Volume volume-69ad7a52-a344-417d-a58b-49fe68fc492a (69ad7a52-a344-417d-a58b-49fe68fc492a): created successfully Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcdae37-a331-447b-9743-d256b0882de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:29:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Flow 'volume_create_manager' (aab8419c-9c5d-450b-92d5-7c669c8717c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:29:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c359e653-25e6-4178-bc49-955efc2247ce tempest-VolumesListAdminTestJSON-274771334 None] Created volume successfully. Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Acquiring lock "cinder-69ad7a52-a344-417d-a58b-49fe68fc492a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "cinder-69ad7a52-a344-417d-a58b-49fe68fc492a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Acquiring lock "cinder-quobyte-69ad7a52-a344-417d-a58b-49fe68fc492a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "cinder-quobyte-69ad7a52-a344-417d-a58b-49fe68fc492a" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df87f96-f2ca-4fcc-8e3f-beaec832c5d3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-b8b92f90-3330-47e0-9da8-c1ed41315eeb-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-b8b92f90-3330-47e0-9da8-c1ed41315eeb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-quobyte-b8b92f90-3330-47e0-9da8-c1ed41315eeb" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-b8b92f90-3330-47e0-9da8-c1ed41315eeb" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661b31d-6c64-4763-982a-3ea13a6e5b6a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:50 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a Jul 08 16:29:50 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:50 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb Jul 08 16:29:50 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:51 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:51 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a Jul 08 16:29:51 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:51 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:51 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb Jul 08 16:29:51 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:51 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-69ad7a52-a344-417d-a58b-49fe68fc492a" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "cinder-quobyte-69ad7a52-a344-417d-a58b-49fe68fc492a" released by "delete_volume" :: held 1.689s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:51 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b92f90-3330-47e0-9da8-c1ed41315eeb" returned: 0 in 0.692s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-b8b92f90-3330-47e0-9da8-c1ed41315eeb" released by "delete_volume" :: held 1.570s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Created reservations ['96e98519-df36-4190-b689-f6394af902ee', '629b3549-8765-43b2-a5b6-65777715439c', '081a7430-4631-4835-bfa2-b4748f95908b', '34707563-a279-446a-ad68-eb8e9e335357'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Created reservations ['10fc8735-d576-4ebd-8d4f-936fee4abe21', '3fba8421-3f1f-4125-b2c4-1c3f656aa4f3', '4832954d-f2c7-417e-846e-7c8fff39c270', 'e49ceaca-5a22-4902-b4d8-303ccd639a45'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:52 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:52 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:52 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:52 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-27b07eaa-dece-4fd0-a745-86f769d686d1-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-27b07eaa-dece-4fd0-a745-86f769d686d1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-quobyte-27b07eaa-dece-4fd0-a745-86f769d686d1" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-27b07eaa-dece-4fd0-a745-86f769d686d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcde994-241a-44e4-9cce-02a2cd9ba1ce]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:52 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Deleted volume successfully. Jul 08 16:29:52 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Deleted volume successfully. Jul 08 16:29:52 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 Jul 08 16:29:52 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-748bad18-fcce-4971-a442-b2fba3cf8489 tempest-VolumesListAdminTestJSON-274771334 None] Lock "cinder-69ad7a52-a344-417d-a58b-49fe68fc492a-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a8b76503-3bb4-42ca-a5f7-ff97cdc5c820 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-b8b92f90-3330-47e0-9da8-c1ed41315eeb-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:53 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1" returned: 0 in 0.811s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:53 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1 Jul 08 16:29:53 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:54 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-27b07eaa-dece-4fd0-a745-86f769d686d1" returned: 0 in 0.699s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-27b07eaa-dece-4fd0-a745-86f769d686d1" released by "delete_volume" :: held 1.550s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Created reservations ['846afb5b-9b70-4ba8-b236-36ccad81c2a4', 'ed78076b-5660-4078-b68f-877cec9fb9d5', 'cf2a1a52-2eab-4232-b414-72302457abff', '606e376b-c7b0-4ce0-84c8-8ee05b96220a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:54 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:54 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "cinder-quobyte-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[859efb92-8056-4e15-80d0-f2b16dda0a9d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:55 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.750s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Deleted volume successfully. Jul 08 16:29:55 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 Jul 08 16:29:55 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-014cd909-ea35-4312-b2f9-a193e35b4319 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-27b07eaa-dece-4fd0-a745-86f769d686d1-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:55 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" returned: 0 in 0.765s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:55 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177 Jul 08 16:29:55 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:56 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" returned: 0 in 0.681s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-quobyte-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177" released by "delete_volume" :: held 1.493s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Created reservations ['8210f3ff-e968-4cf0-a702-4a3ddfecf46a', '4bac2728-2682-40a2-9955-35d5b9f10bfa', '6cd41a73-d61e-4f22-bb1a-1c1193d96afb', 'e807ebb0-af87-41ab-8133-3fbe94343e24'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:29:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:29:56 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:29:56 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:29:57 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 08 16:29:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.712s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:29:57 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:29:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Deleted volume successfully. Jul 08 16:29:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c95efa48-8d65-4148-aeb0-f5b3df754993 tempest-VolumesListAdminTestJSON-552821517 None] Lock "cinder-1f961cf5-cbe4-4eb4-ab83-7d08c3e35177-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Flow 'volume_create_manager' (ce986d41-be8d-4417-9c33-99b84cfea5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c084e-d646-430b-9c2c-4f58cda4205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c084e-d646-430b-9c2c-4f58cda4205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2005556682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf0c0e-44cd-4958-aabe-c7991264e649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a13fb2ec684f06b4ebe21b6ae934aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:03Z,use_quota=True,user_id='0dc98336ad074dbcbf41c56c09a92ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3e3433-754e-4875-8a37-9a6e64b5c625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3e3433-754e-4875-8a37-9a6e64b5c625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2746af26-cf75-4211-bac2-cf7e9bf244fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2746af26-cf75-4211-bac2-cf7e9bf244fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcf0c0e-44cd-4958-aabe-c7991264e649', 'volume_name': 'volume-5dcf0c0e-44cd-4958-aabe-c7991264e649', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3866b44-3710-4d9e-8807-7523605724ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3866b44-3710-4d9e-8807-7523605724ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4399778f-5d0c-4d88-96d7-f3a6a5907bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Volume 5dcf0c0e-44cd-4958-aabe-c7991264e649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcf0c0e-44cd-4958-aabe-c7991264e649', 'volume_size': 1} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2005556682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf0c0e-44cd-4958-aabe-c7991264e649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a13fb2ec684f06b4ebe21b6ae934aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:03Z,use_quota=True,user_id='0dc98336ad074dbcbf41c56c09a92ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Creating volume 5dcf0c0e-44cd-4958-aabe-c7991264e649 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:30:03 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:30:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:03 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 1073741824 Jul 08 16:30:03 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:04 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 1073741824" returned: 0 in 0.878s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:04 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 Jul 08 16:30:04 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:05 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649" returned: 0 in 0.665s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4399778f-5d0c-4d88-96d7-f3a6a5907bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcf0c0e-44cd-4958-aabe-c7991264e649', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766af29-a669-48e0-b7ad-8ade7b0836b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Volume volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 (5dcf0c0e-44cd-4958-aabe-c7991264e649): created successfully Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766af29-a669-48e0-b7ad-8ade7b0836b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Flow 'volume_create_manager' (ce986d41-be8d-4417-9c33-99b84cfea5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8ef23d86-f22f-4b77-964a-e83ee837eca4 tempest-VolumesTransfersV355Test-557858126 None] Created volume successfully. Jul 08 16:30:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4f82ec5b-fdb1-4d82-9a52-e50565cd5bfb tempest-VolumesTransfersV355Test-37925865 None] Transfer volume completed successfully. Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "cinder-5dcf0c0e-44cd-4958-aabe-c7991264e649-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-5dcf0c0e-44cd-4958-aabe-c7991264e649-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "cinder-quobyte-5dcf0c0e-44cd-4958-aabe-c7991264e649" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-quobyte-5dcf0c0e-44cd-4958-aabe-c7991264e649" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83541c-65c9-41a1-845d-fd88aa61e4d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:07 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 Jul 08 16:30:07 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:07 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649" returned: 0 in 0.826s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:08 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649 Jul 08 16:30:08 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:08 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5dcf0c0e-44cd-4958-aabe-c7991264e649" returned: 0 in 0.674s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-quobyte-5dcf0c0e-44cd-4958-aabe-c7991264e649" released by "delete_volume" :: held 1.544s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Created reservations ['c1c2ab49-5be1-4633-8cac-6e15dab0fd54', '4c25d9fb-9863-4e10-8af6-e6c40952a0e8', 'e6ffc1db-e94e-4781-9ef1-544b2ce80743', '20a85956-4a4d-4b88-bcb8-2bb31a53aa9b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:08 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:30:08 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:09 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.767s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:30:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Deleted volume successfully. Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9ca561ee-3459-404a-9d78-9967d664eee5 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-5dcf0c0e-44cd-4958-aabe-c7991264e649-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Flow 'volume_create_manager' (d94d2aba-6d84-408a-b46d-3135a53d1e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4146b1d9-14ce-406e-8b3d-0dd163463ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4146b1d9-14ce-406e-8b3d-0dd163463ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-291042306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172828da-9042-4254-a6f2-d1f2d2d45301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a13fb2ec684f06b4ebe21b6ae934aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:10Z,use_quota=True,user_id='0dc98336ad074dbcbf41c56c09a92ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf4778a-bb06-43bc-b854-a4a4329e424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf4778a-bb06-43bc-b854-a4a4329e424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2def25-3902-46fe-84af-7c82971f4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2def25-3902-46fe-84af-7c82971f4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172828da-9042-4254-a6f2-d1f2d2d45301', 'volume_name': 'volume-172828da-9042-4254-a6f2-d1f2d2d45301', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20199114-74e3-4fb7-a2fc-c8070c31cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20199114-74e3-4fb7-a2fc-c8070c31cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f8552-b981-4d28-bfb0-ec45b2771b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:09 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Volume 172828da-9042-4254-a6f2-d1f2d2d45301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172828da-9042-4254-a6f2-d1f2d2d45301', 'volume_size': 1} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-291042306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172828da-9042-4254-a6f2-d1f2d2d45301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a13fb2ec684f06b4ebe21b6ae934aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:10Z,use_quota=True,user_id='0dc98336ad074dbcbf41c56c09a92ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Creating volume 172828da-9042-4254-a6f2-d1f2d2d45301 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:30:09 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:30:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:10 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 1073741824 Jul 08 16:30:10 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:10 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 1073741824" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:10 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 Jul 08 16:30:10 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:11 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301" returned: 0 in 0.723s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f8552-b981-4d28-bfb0-ec45b2771b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172828da-9042-4254-a6f2-d1f2d2d45301', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf5bc88-f461-4cb6-84ac-715ab5187143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:11 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Volume volume-172828da-9042-4254-a6f2-d1f2d2d45301 (172828da-9042-4254-a6f2-d1f2d2d45301): created successfully Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf5bc88-f461-4cb6-84ac-715ab5187143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:11 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Flow 'volume_create_manager' (d94d2aba-6d84-408a-b46d-3135a53d1e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-50480c72-23d0-4548-bc2a-7a7155ea6c85 tempest-VolumesTransfersV355Test-557858126 None] Created volume successfully. Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "cinder-172828da-9042-4254-a6f2-d1f2d2d45301-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-172828da-9042-4254-a6f2-d1f2d2d45301-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "cinder-quobyte-172828da-9042-4254-a6f2-d1f2d2d45301" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-quobyte-172828da-9042-4254-a6f2-d1f2d2d45301" acquired by "delete_volume" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[326a778c-2d90-4441-814f-20d74a54c223]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:12 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 Jul 08 16:30:12 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:13 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301" returned: 0 in 0.840s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:13 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301 Jul 08 16:30:13 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=87,cinder:SELECT=77,cinder:DELETE=6,cinder:INSERT=23 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Flow 'volume_create_manager' (b00eb7a8-9a37-49c4-a037-6820c1c7828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19559080-1e98-4601-93af-542d3605e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19559080-1e98-4601-93af-542d3605e18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2020493364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aaf043-d7cb-4b05-819a-ce87ca929bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fde417d1294841b300ed294b1b64d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:14Z,use_quota=True,user_id='1e64e3e6ef5d4e42a653e7edaa22f54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036929e-1aa7-414d-bda7-1a3078afabd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036929e-1aa7-414d-bda7-1a3078afabd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b9c1b2-0a10-4c17-a835-600311f5c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:30:13 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-172828da-9042-4254-a6f2-d1f2d2d45301" returned: 0 in 0.688s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-quobyte-172828da-9042-4254-a6f2-d1f2d2d45301" released by "delete_volume" :: held 1.577s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:30:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Created reservations ['92f38246-7661-48e3-9a04-27a1ceac942e', '7d23e139-e2a4-4cd4-8249-ef9878dca06b', 'c7bb561f-698e-4e40-b0bf-d6beef70d400', '76acb643-79cc-432d-9bed-51ddc1b190a7'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:14 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:30:14 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b9c1b2-0a10-4c17-a835-600311f5c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'volume_name': 'volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7416c4d8-0aeb-4c5e-b81e-1b5a1d137bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7416c4d8-0aeb-4c5e-b81e-1b5a1d137bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c413e3da-ea94-4dc0-ba7e-ff8ef3e3a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:14 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Trying to clone b6aaf043-d7cb-4b05-819a-ce87ca929bc4 from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:30:14 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Image download 20.69 MB at 20.69 MB/s Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b676e-ff7a-4563-926e-cb264fb839e8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:14 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:30:14 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD Jul 08 16:30:14 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Deleted volume successfully. Jul 08 16:30:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cc60866a-fb77-4825-b614-36af4e8ec6a7 tempest-VolumesTransfersV355Test-37095241 None] Lock "cinder-172828da-9042-4254-a6f2-d1f2d2d45301-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:30:15 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:15 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 is fetched for user 1e64e3e6ef5d4e42a653e7edaa22f54c. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:30:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[56de520f-6f6f-45a4-8699-dce84d9b033a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:15 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD Jul 08 16:30:15 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:16 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2020493364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aaf043-d7cb-4b05-819a-ce87ca929bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fde417d1294841b300ed294b1b64d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:14Z,use_quota=True,user_id='1e64e3e6ef5d4e42a653e7edaa22f54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Creating volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:30:16 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:30:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:16 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1073741824 Jul 08 16:30:16 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:17 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1073741824" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:17 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:17 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:17 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 0.681s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:17 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Attempting download of c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:30:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e6ea6-aeab-454c-9e18-af719d4c8eef]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:18 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc Jul 08 16:30:18 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:18 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc" returned: 0 in 0.762s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:18 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc Jul 08 16:30:18 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:19 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:30:19 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:19 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc" returned: 1 in 0.764s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_f0r4mulc' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b0600-d75d-4779-853e-003f0d7e6d7a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:19 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD Jul 08 16:30:19 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:20 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:30:20 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 was qcow2, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:30:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:20 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:20 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:22 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 1.961s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:22 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3_28tejzzddevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:30:22 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Converted 112.00 MB image at 57.08 MB/s Jul 08 16:30:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:22 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1G Jul 08 16:30:22 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:23 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 1G" returned: 0 in 0.747s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f432205-20bf-4b15-8ca0-968b6051b248]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:23 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:23 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:23 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:23 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:23 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:24 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 1 in 0.785s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Downloaded image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}])) to volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Temporary image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 for user 1e64e3e6ef5d4e42a653e7edaa22f54c is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Marking volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Copying metadata from image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 to b6aaf043-d7cb-4b05-819a-ce87ca929bc4. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Creating volume glance metadata for volume b6aaf043-d7cb-4b05-819a-ce87ca929bc4 backed by image c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c413e3da-ea94-4dc0-ba7e-ff8ef3e3a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'volume_size': 1, 'image_id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adf384eea3ad43caa6f550e1a736c077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3', 'created_at': datetime.datetime(2026, 7, 8, 14, 7, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3569cfc-c6ea-4cee-b9bd-c58dcda5aeb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfbde4f-ff46-4e5a-b918-b9f716c1641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Volume volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 (b6aaf043-d7cb-4b05-819a-ce87ca929bc4): created successfully Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfbde4f-ff46-4e5a-b918-b9f716c1641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Flow 'volume_create_manager' (b00eb7a8-9a37-49c4-a037-6820c1c7828b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:24 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-26b0e955-66e6-4442-a13a-c53bd0bd629a tempest-TestShelveInstance-1308526403 None] Created volume successfully. Jul 08 16:30:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd28ef-74aa-42fe-b88c-0c48844d2e3d]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:30:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:33 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:33 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:34 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:34 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:30:34 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:34 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 1 in 0.787s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.708s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e11700e5-47c8-4cf6-8705-8276658589e4', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:30:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-443fa2a3-b433-4071-957d-f3fc4b16d495 req-37be4063-9560-4b4b-8e86-2347de49cab1 tempest-TestShelveInstance-1308526403 None] attachment_update completed successfully. Jul 08 16:30:45 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=77,cinder:SELECT=55,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:30:45 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=16,cinder:INSERT=13,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Flow 'volume_create_manager' (c00d35f3-5b0e-429f-a600-d65d963b43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15bb674-1a9c-407b-928c-648df427da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15bb674-1a9c-407b-928c-648df427da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1672055510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38099f3e-4e3c-401b-aa2f-67444bda3314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca124e208f0a4597b0fdcc2b9abacef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:47Z,use_quota=True,user_id='e186e6221d3e4c93b055c1754b188d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a166ec0e-88c0-45cf-9580-949e97375a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a166ec0e-88c0-45cf-9580-949e97375a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8195961-b788-4a48-8d51-88f6502a536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8195961-b788-4a48-8d51-88f6502a536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38099f3e-4e3c-401b-aa2f-67444bda3314', 'volume_name': 'volume-38099f3e-4e3c-401b-aa2f-67444bda3314', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a7ada7-1b5b-4532-8f48-ae20b260b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a7ada7-1b5b-4532-8f48-ae20b260b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dd5b36-c65b-4a33-b39c-d1ee277e50a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Volume 38099f3e-4e3c-401b-aa2f-67444bda3314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38099f3e-4e3c-401b-aa2f-67444bda3314', 'volume_size': 1} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1672055510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38099f3e-4e3c-401b-aa2f-67444bda3314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca124e208f0a4597b0fdcc2b9abacef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:30:47Z,use_quota=True,user_id='e186e6221d3e4c93b055c1754b188d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Creating volume 38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:30:46 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:30:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:46 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 1073741824 Jul 08 16:30:46 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:47 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 1073741824" returned: 0 in 1.066s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:30:48 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:30:48 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:30:48 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.817s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dd5b36-c65b-4a33-b39c-d1ee277e50a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38099f3e-4e3c-401b-aa2f-67444bda3314', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f4aecd-5712-46f6-8a66-bf4350660957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:30:48 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Volume volume-38099f3e-4e3c-401b-aa2f-67444bda3314 (38099f3e-4e3c-401b-aa2f-67444bda3314): created successfully Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f4aecd-5712-46f6-8a66-bf4350660957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:30:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Flow 'volume_create_manager' (c00d35f3-5b0e-429f-a600-d65d963b43c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:30:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-16a06c0d-ebec-4a98-ba91-c2911e2c6052 tempest-TestStampPattern-448578937 None] Created volume successfully. Jul 08 16:30:58 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:30:58 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:31:13 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-b04aec89-5e60-4cc3-9a2c-cdd532c9ad2b req-a5892ed7-dd51-496e-91b2-ff4db3b26457 tempest-TestShelveInstance-1308526403 None] Terminate volume connection completed successfully. Jul 08 16:31:13 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-b04aec89-5e60-4cc3-9a2c-cdd532c9ad2b req-a5892ed7-dd51-496e-91b2-ff4db3b26457 tempest-TestShelveInstance-1308526403 None] Deleting attachment e11700e5-47c8-4cf6-8705-8276658589e4. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:31:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f2ca87-3e26-464d-9944-41e4e2e8b4cc]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:18 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:31:18 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:19 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 0.733s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:19 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:31:19 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:19 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:31:19 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:20 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 1 in 0.857s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:31:20 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.631s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:31:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39c8984e-1cd6-45e4-875c-c8e059d6efe3', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:31:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-9e4b7196-5275-4796-b2e7-39487114b170 req-d2e3df41-98b6-4818-b406-002d488f6a3c tempest-TestShelveInstance-1308526403 None] attachment_update completed successfully. Jul 08 16:31:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e40d229-a6dc-4b41-ba6f-60a7bcaa9a55]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:27 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:31:27 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:28 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.826s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-38099f3e-4e3c-401b-aa2f-67444bda3314', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '394db2d3-fe33-4940-8909-fda8d6c3d1a8', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:31:28 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-c90dc077-2936-4ab1-a9ef-1dad7811f59f req-fba121fb-20d5-4e79-9fc9-0b062aed5b76 tempest-TestStampPattern-448578937 None] attachment_update completed successfully. Jul 08 16:31:36 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-388d37a3-475f-4117-86aa-d87de599e46b req-d9d1ca4f-fc2a-48c2-a3c3-ca66da0a0810 tempest-TestStampPattern-448578937 None] Terminate volume connection completed successfully. Jul 08 16:31:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-388d37a3-475f-4117-86aa-d87de599e46b req-d9d1ca4f-fc2a-48c2-a3c3-ca66da0a0810 tempest-TestStampPattern-448578937 None] Deleting attachment 394db2d3-fe33-4940-8909-fda8d6c3d1a8. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Creating offline snapshot 0983e07f-6ffd-482c-a4dd-e3c79bf00deb of volume 38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc05e31-fd92-4df0-a741-dc0a80b4afef]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:39 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:31:39 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:39 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.807s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:39 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb 1G Jul 08 16:31:39 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:40 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb 1G" returned: 0 in 0.789s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38099f3e-4e3c-401b-aa2f-67444bda3314 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:40 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38099f3e-4e3c-401b-aa2f-67444bda3314 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:31:40 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:41 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38099f3e-4e3c-401b-aa2f-67444bda3314 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.750s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:41 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb is being set with open permissions: ugo+rw Jul 08 16:31:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:41 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:31:41 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:42 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.636s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:42 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info Jul 08 16:31:42 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:42 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info" returned: 0 in 0.683s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:42 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info is being set with open permissions: ugo+rw Jul 08 16:31:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:42 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info Jul 08 16:31:42 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:43 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.info" returned: 0 in 0.681s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-52bc3c5b-8d25-4f7e-bb71-e48b9732fb70 tempest-TestStampPattern-448578937 None] Create snapshot completed successfully Jul 08 16:31:53 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:31:53 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Flow 'volume_create_manager' (e2ae6cad-4722-4ed7-bd19-b3f3993b5b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090f380e-f91b-41b8-b59b-7cad12bda9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090f380e-f91b-41b8-b59b-7cad12bda9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-289445300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502e4e70-c28b-43b6-b2d8-df27a3734d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca124e208f0a4597b0fdcc2b9abacef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0983e07f-6ffd-482c-a4dd-e3c79bf00deb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:31:54Z,use_quota=True,user_id='e186e6221d3e4c93b055c1754b188d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675a7efd-7901-4c78-8d11-fbfc3cf0cc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675a7efd-7901-4c78-8d11-fbfc3cf0cc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bec698-0544-4d6a-bae2-1625d697cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bec698-0544-4d6a-bae2-1625d697cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '502e4e70-c28b-43b6-b2d8-df27a3734d98', 'volume_name': 'volume-502e4e70-c28b-43b6-b2d8-df27a3734d98', 'volume_size': 1, 'snapshot_id': '0983e07f-6ffd-482c-a4dd-e3c79bf00deb'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f478e26d-2a81-4fdb-af6d-0b77463b576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f478e26d-2a81-4fdb-af6d-0b77463b576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f89468-034f-4c63-bfb4-e791984e4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:31:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Volume 502e4e70-c28b-43b6-b2d8-df27a3734d98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-502e4e70-c28b-43b6-b2d8-df27a3734d98', 'volume_size': 1, 'snapshot_id': '0983e07f-6ffd-482c-a4dd-e3c79bf00deb'} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-502e4e70-c28b-43b6-b2d8-df27a3734d98" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-502e4e70-c28b-43b6-b2d8-df27a3734d98" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Creating volume 502e4e70-c28b-43b6-b2d8-df27a3734d98 from snapshot 0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] snapshot: 0983e07f-6ffd-482c-a4dd-e3c79bf00deb, volume: 502e4e70-c28b-43b6-b2d8-df27a3734d98, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b282d9f-6c35-4166-9768-b705a7eb0cf8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:54 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:31:54 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:55 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38099f3e-4e3c-401b-aa2f-67444bda3314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a08cb-a810-4e60-9506-5ae1bd810f6c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:55 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:31:55 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:56 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 08 16:31:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 1.068s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:31:56 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:31:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:56 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 Jul 08 16:31:56 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:31:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-1ff40bc0-92fe-46a0-bd7b-213056a751de tempest-TestShelveInstance-1308526403 None] Terminate volume connection completed successfully. Jul 08 16:31:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-1ff40bc0-92fe-46a0-bd7b-213056a751de tempest-TestShelveInstance-1308526403 None] Deleting attachment 39c8984e-1cd6-45e4-875c-c8e059d6efe3. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Acquiring lock "cinder-b6aaf043-d7cb-4b05-819a-ce87ca929bc4-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "cinder-b6aaf043-d7cb-4b05-819a-ce87ca929bc4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Acquiring lock "cinder-quobyte-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "cinder-quobyte-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[86479e83-9cb3-4f75-855a-d089c9e67ada]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:31:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:31:59 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:31:59 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:00 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 1.269s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:00 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:32:00 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:01 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 1 in 1.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:32:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:02 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4 Jul 08 16:32:02 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:02 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98" returned: 0 in 6.519s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b155115-3a3a-4b69-b42f-ed176ae9ac9f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:03 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:32:03 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:03 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" returned: 0 in 1.510s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "cinder-quobyte-b6aaf043-d7cb-4b05-819a-ce87ca929bc4" released by "delete_volume" :: held 4.746s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG cinder.quota [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Created reservations ['82c982d6-3084-4397-a73f-a33b5f288eba', '321609a0-f28e-4ce0-9d5e-506e0f02d167', '95ff32ee-1b76-4c71-a4a1-a3cb825c843d', 'a849ef4a-01a2-4e1c-9378-5172b8f17c4c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:03 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:03 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:04 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 1.581s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:32:04 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Converted 1024.00 MB image at 156.96 MB/s Jul 08 16:32:04 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 is being set with open permissions: ugo+rw Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:04 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 Jul 08 16:32:04 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:04 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.013s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG cinder.manager [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Deleted volume successfully. Jul 08 16:32:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [req-8feb65b8-4cce-480d-9ab6-acc96bb8192d req-8ceb58bc-083a-45eb-a186-fc81a2ef74c4 tempest-TestShelveInstance-1308526403 None] Lock "cinder-b6aaf043-d7cb-4b05-819a-ce87ca929bc4-delete_volume" released by "delete_volume" :: held 6.131s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:05 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" released by "_copy_volume_from_snapshot" :: held 10.956s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-502e4e70-c28b-43b6-b2d8-df27a3734d98" released by "_create_volume_from_snapshot" :: held 10.993s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f89468-034f-4c63-bfb4-e791984e4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502e4e70-c28b-43b6-b2d8-df27a3734d98', 'volume_size': 1, 'snapshot_id': '0983e07f-6ffd-482c-a4dd-e3c79bf00deb'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7818ab0-c175-493a-a3c1-8b0841cf8a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Volume volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 (502e4e70-c28b-43b6-b2d8-df27a3734d98): created successfully Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7818ab0-c175-493a-a3c1-8b0841cf8a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Flow 'volume_create_manager' (e2ae6cad-4722-4ed7-bd19-b3f3993b5b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d34f2346-e409-45cc-9d16-03e477bb52d2 tempest-TestStampPattern-448578937 None] Created volume successfully. Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (8b9bd435-1989-49be-b517-a58f2cf1ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c0f43e-b9ec-4edd-9c31-88fdd00d2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c0f43e-b9ec-4edd-9c31-88fdd00d2304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773403678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382fca13-6808-4b60-b264-c2842d5d708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:16Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae805991-3d92-4b9a-b4a9-7e84bc0e23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae805991-3d92-4b9a-b4a9-7e84bc0e23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b26bc-955b-4851-8d16-11b6b0622f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b26bc-955b-4851-8d16-11b6b0622f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382fca13-6808-4b60-b264-c2842d5d708d', 'volume_name': 'volume-382fca13-6808-4b60-b264-c2842d5d708d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe235b5-8de9-40ea-974e-6d504df2ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe235b5-8de9-40ea-974e-6d504df2ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367c735a-fdd6-403e-87be-24177e3cb384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume 382fca13-6808-4b60-b264-c2842d5d708d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382fca13-6808-4b60-b264-c2842d5d708d', 'volume_size': 1} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773403678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382fca13-6808-4b60-b264-c2842d5d708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:16Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume 382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:16 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:16 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d 1073741824 Jul 08 16:32:16 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:16 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d 1073741824" returned: 0 in 0.868s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:16 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d Jul 08 16:32:16 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:17 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367c735a-fdd6-403e-87be-24177e3cb384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382fca13-6808-4b60-b264-c2842d5d708d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52be4497-32eb-483b-86b2-25b46e82edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-382fca13-6808-4b60-b264-c2842d5d708d (382fca13-6808-4b60-b264-c2842d5d708d): created successfully Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52be4497-32eb-483b-86b2-25b46e82edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (8b9bd435-1989-49be-b517-a58f2cf1ad13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-551dac96-7bd9-4c19-a4a5-381735b90efb tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating offline snapshot a60b38e6-64ca-427b-bde0-0f0b13d6622a of volume 382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b80e20-d74d-4b40-97cd-63e66a652a4b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:18 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d Jul 08 16:32:18 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:18 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d" returned: 0 in 0.754s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:19 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a 1G Jul 08 16:32:19 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:19 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:19 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:19 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a 1G" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fca13-6808-4b60-b264-c2842d5d708d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:19 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fca13-6808-4b60-b264-c2842d5d708d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a Jul 08 16:32:19 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:20 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:32:20 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fca13-6808-4b60-b264-c2842d5d708d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:20 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a is being set with open permissions: ugo+rw Jul 08 16:32:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:20 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a Jul 08 16:32:20 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:21 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a" returned: 0 in 0.637s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:21 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info Jul 08 16:32:21 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:21 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info" returned: 0 in 0.651s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:21 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info is being set with open permissions: ugo+rw Jul 08 16:32:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:21 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info Jul 08 16:32:21 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:22 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.info" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.307s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9367b93d-5823-4e78-b017-b47c6b680036 tempest-CreateVolumesFromSnapshotTest-119478388 None] Create snapshot completed successfully Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (0522612e-5e7d-4d44-82db-cf4af1a3df54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b0d2c1-7dc1-42c3-b2f6-d6b8169a9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b0d2c1-7dc1-42c3-b2f6-d6b8169a9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812557554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679e90bc-bbfb-4ccf-8912-757fc58b8b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c4626c-b453-4d11-b2f4-8d6d487a37e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c4626c-b453-4d11-b2f4-8d6d487a37e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52d9730-10fd-48a3-afef-fe8fd872ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52d9730-10fd-48a3-afef-fe8fd872ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679e90bc-bbfb-4ccf-8912-757fc58b8b09', 'volume_name': 'volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900cc35d-fa14-4ebd-9ebd-3a17959cbeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900cc35d-fa14-4ebd-9ebd-3a17959cbeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0718847b-c9d4-43b8-ac8e-20f57192a48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:23 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume 679e90bc-bbfb-4ccf-8912-757fc58b8b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09', 'volume_size': 1} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812557554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679e90bc-bbfb-4ccf-8912-757fc58b8b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume 679e90bc-bbfb-4ccf-8912-757fc58b8b09 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:23 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:23 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 1073741824 Jul 08 16:32:23 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (2aeca99c-fbfb-4d46-8a3b-48554aaf01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af319427-6430-45b1-9764-cc795c0e45b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af319427-6430-45b1-9764-cc795c0e45b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1234734970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0f3bb7-55aa-45c7-9671-f277ee34f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7db61-3a0e-45f1-b9cb-4e2295f3d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7db61-3a0e-45f1-b9cb-4e2295f3d026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ade720-7839-4898-91c9-d3f82ad27ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ade720-7839-4898-91c9-d3f82ad27ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0f3bb7-55aa-45c7-9671-f277ee34f0da', 'volume_name': 'volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92088ad-fd3d-4544-95a5-70d14d76ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92088ad-fd3d-4544-95a5-70d14d76ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3c4149-d015-42ac-ba43-1bebd23a3642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume fc0f3bb7-55aa-45c7-9671-f277ee34f0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da', 'volume_size': 1} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (a8e85755-66ee-424e-a47d-2e463359ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f6b1e7-0337-4da3-9866-caef715eecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f6b1e7-0337-4da3-9866-caef715eecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753146241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd8f50c-cb93-472b-b2d2-95982424bafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5533a8-9fac-4672-ad12-b1f0a7cc5a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5533a8-9fac-4672-ad12-b1f0a7cc5a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b31ecd-807f-4146-8939-cf86c7226953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b31ecd-807f-4146-8939-cf86c7226953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd8f50c-cb93-472b-b2d2-95982424bafe', 'volume_name': 'volume-5fd8f50c-cb93-472b-b2d2-95982424bafe', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c2ce78-f60f-4137-b92e-97947d66bbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c2ce78-f60f-4137-b92e-97947d66bbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5192afd1-7475-438f-9841-6cb2de61c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume 5fd8f50c-cb93-472b-b2d2-95982424bafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd8f50c-cb93-472b-b2d2-95982424bafe', 'volume_size': 1} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:24 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 1073741824" returned: 0 in 0.945s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (d3d08551-88ce-4b27-9401-e8641a63c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdec6198-22b1-4837-8170-02cb5597dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdec6198-22b1-4837-8170-02cb5597dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201389806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aeb7ad9-1272-4c53-aea2-057488db3ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:25Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7414b9d-3310-4406-9863-65bc5342665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7414b9d-3310-4406-9863-65bc5342665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca653699-9634-4417-8b6e-c9f7708a414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca653699-9634-4417-8b6e-c9f7708a414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aeb7ad9-1272-4c53-aea2-057488db3ceb', 'volume_name': 'volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c3c6b5-b3d4-446d-a12f-0ed6aa440088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c3c6b5-b3d4-446d-a12f-0ed6aa440088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6557392d-671c-4661-8bf0-2f881ca0219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume 7aeb7ad9-1272-4c53-aea2-057488db3ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb', 'volume_size': 1} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (7d444939-8650-4b3c-8b49-c313850bcebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bb1aec-27c9-40b6-b768-0a6ae4866c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bb1aec-27c9-40b6-b768-0a6ae4866c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726955065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aee44b-fa75-4f90-81e8-dd3d352272d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:25Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8494e052-c67b-4683-8762-5c23e46dfbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8494e052-c67b-4683-8762-5c23e46dfbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9277c2f4-111f-463d-ac28-53a4d84289c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9277c2f4-111f-463d-ac28-53a4d84289c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04aee44b-fa75-4f90-81e8-dd3d352272d2', 'volume_name': 'volume-04aee44b-fa75-4f90-81e8-dd3d352272d2', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9fa7bf-cab9-45af-947d-0b063566e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9fa7bf-cab9-45af-947d-0b063566e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffc633d-384c-487e-9d59-b9d7d227214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume 04aee44b-fa75-4f90-81e8-dd3d352272d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04aee44b-fa75-4f90-81e8-dd3d352272d2', 'volume_size': 1} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:25 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1234734970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0f3bb7-55aa-45c7-9671-f277ee34f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume fc0f3bb7-55aa-45c7-9671-f277ee34f0da {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:25 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:25 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da 1073741824 Jul 08 16:32:25 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0718847b-c9d4-43b8-ac8e-20f57192a48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af17a55f-0f2b-41d9-ad74-123d72e0902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 (679e90bc-bbfb-4ccf-8912-757fc58b8b09): created successfully Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af17a55f-0f2b-41d9-ad74-123d72e0902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (0522612e-5e7d-4d44-82db-cf4af1a3df54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cb877ddd-2f2d-4cb3-84b2-7863bf01442c tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:26 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da 1073741824" returned: 0 in 0.809s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:26 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da Jul 08 16:32:26 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:27 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" returned: 0 in 0.631s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753146241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd8f50c-cb93-472b-b2d2-95982424bafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:24Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume 5fd8f50c-cb93-472b-b2d2-95982424bafe {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:27 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3c4149-d015-42ac-ba43-1bebd23a3642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:27 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe 1073741824 Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71898f8-5ebb-4edb-afdc-f82ccb385e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:27 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:27 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da (fc0f3bb7-55aa-45c7-9671-f277ee34f0da): created successfully Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71898f8-5ebb-4edb-afdc-f82ccb385e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (2aeca99c-fbfb-4d46-8a3b-48554aaf01f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a5fdd466-60dc-454a-bac5-ddf074758dc1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:27 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe 1073741824" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:28 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe Jul 08 16:32:28 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:28 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe" returned: 0 in 0.643s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201389806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aeb7ad9-1272-4c53-aea2-057488db3ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:25Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume 7aeb7ad9-1272-4c53-aea2-057488db3ceb {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:28 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:28 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb 1073741824 Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5192afd1-7475-438f-9841-6cb2de61c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd8f50c-cb93-472b-b2d2-95982424bafe', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:28 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9901a29-ed46-4522-be10-a5ab0e642be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:28 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-5fd8f50c-cb93-472b-b2d2-95982424bafe (5fd8f50c-cb93-472b-b2d2-95982424bafe): created successfully Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9901a29-ed46-4522-be10-a5ab0e642be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (a8e85755-66ee-424e-a47d-2e463359ac29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:28 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cb580b09-e0bd-4133-a352-c9c025d8495a tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:29 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb 1073741824" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:29 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb Jul 08 16:32:29 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:30 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb" returned: 0 in 0.664s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.822s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726955065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aee44b-fa75-4f90-81e8-dd3d352272d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c60f88f0d0846aab0e135ad1d79e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:25Z,use_quota=True,user_id='7c4f8c28fb46421f8a089331247ab6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Creating volume 04aee44b-fa75-4f90-81e8-dd3d352272d2 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:30 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6557392d-671c-4661-8bf0-2f881ca0219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:30 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 1073741824 Jul 08 16:32:30 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d96f769-cba5-416b-bb1a-6fe7a3bdf274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:30 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb (7aeb7ad9-1272-4c53-aea2-057488db3ceb): created successfully Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d96f769-cba5-416b-bb1a-6fe7a3bdf274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (d3d08551-88ce-4b27-9401-e8641a63c700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dadf2153-ee26-4a92-bab6-22c453a4cb52 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:31 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 1073741824" returned: 0 in 0.842s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:31 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 Jul 08 16:32:31 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:31 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2" returned: 0 in 0.674s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffc633d-384c-487e-9d59-b9d7d227214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04aee44b-fa75-4f90-81e8-dd3d352272d2', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0c38cc-4555-430e-802c-6bb6c5d4f962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Volume volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 (04aee44b-fa75-4f90-81e8-dd3d352272d2): created successfully Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0c38cc-4555-430e-802c-6bb6c5d4f962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Flow 'volume_create_manager' (7d444939-8650-4b3c-8b49-c313850bcebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cccdda42-5cb3-47a7-a770-a8abcbb4b39a tempest-CreateVolumesFromSnapshotTest-119478388 None] Created volume successfully. Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-04aee44b-fa75-4f90-81e8-dd3d352272d2-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-04aee44b-fa75-4f90-81e8-dd3d352272d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-04aee44b-fa75-4f90-81e8-dd3d352272d2" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-04aee44b-fa75-4f90-81e8-dd3d352272d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[da748017-1262-4648-9eb3-315524523dc0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:33 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 Jul 08 16:32:33 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:33 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2" returned: 0 in 0.763s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:33 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2 Jul 08 16:32:33 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:34 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-04aee44b-fa75-4f90-81e8-dd3d352272d2" returned: 0 in 0.638s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-04aee44b-fa75-4f90-81e8-dd3d352272d2" released by "delete_volume" :: held 1.439s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['cdb0dc07-d7c6-4df4-aea7-75eb84f6dd55', 'ccae7d4e-fdaf-48ea-acc5-6ab921330622', '499daa64-f007-4b1f-afba-12aebb2817fe', '1773ebbc-f514-4ecc-a4ef-a16d1b95e924'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:34 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:34 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-7aeb7ad9-1272-4c53-aea2-057488db3ceb-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-7aeb7ad9-1272-4c53-aea2-057488db3ceb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:35 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.665s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-7aeb7ad9-1272-4c53-aea2-057488db3ceb" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-142fd40f-a191-47aa-ab8f-870284dd6fe3 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-04aee44b-fa75-4f90-81e8-dd3d352272d2-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-7aeb7ad9-1272-4c53-aea2-057488db3ceb" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac301088-3020-44dc-a623-3f2ab9d140dc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:35 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb Jul 08 16:32:35 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:35 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:36 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb Jul 08 16:32:36 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:36 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7aeb7ad9-1272-4c53-aea2-057488db3ceb" returned: 0 in 0.646s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-7aeb7ad9-1272-4c53-aea2-057488db3ceb" released by "delete_volume" :: held 1.474s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['50e72b8a-c8c9-421e-a499-9beb378f2263', '47f21cef-4bdc-4f21-ba10-64b6703f20a7', '3a365ffb-a4c2-4a48-bb70-999bc729ea9b', '3fadcac6-71fb-40c0-ba20-7d81a59df99f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:36 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:36 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-5fd8f50c-cb93-472b-b2d2-95982424bafe-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-5fd8f50c-cb93-472b-b2d2-95982424bafe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-5fd8f50c-cb93-472b-b2d2-95982424bafe" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-5fd8f50c-cb93-472b-b2d2-95982424bafe" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bd3b58-b0a7-4309-bae2-a97b5205951f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:37 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.692s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f0606814-4c32-48cb-a614-3873391791c0 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-7aeb7ad9-1272-4c53-aea2-057488db3ceb-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:37 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe Jul 08 16:32:37 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:38 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:38 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe Jul 08 16:32:38 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:38 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5fd8f50c-cb93-472b-b2d2-95982424bafe" returned: 0 in 0.637s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-5fd8f50c-cb93-472b-b2d2-95982424bafe" released by "delete_volume" :: held 1.459s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['43ef8e91-de9b-42cf-8265-801d8ce865c4', '66bcb3e0-9141-4b3e-91da-d5ac659103e5', '528bb2b8-9d4e-476d-ad39-181468ff7e7c', '5f91b5c9-3e71-44df-a5b0-9416ed8bd659'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:38 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:38 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-fc0f3bb7-55aa-45c7-9671-f277ee34f0da-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-fc0f3bb7-55aa-45c7-9671-f277ee34f0da-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:39 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.639s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8b5237a3-9ac3-43fe-9dfc-1f18f5e388e4 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-5fd8f50c-cb93-472b-b2d2-95982424bafe-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ef682-0dfc-47b1-8316-722367379e0c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:39 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da Jul 08 16:32:39 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:40 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" returned: 0 in 0.735s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:40 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da Jul 08 16:32:40 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:41 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" returned: 0 in 0.646s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-fc0f3bb7-55aa-45c7-9671-f277ee34f0da" released by "delete_volume" :: held 1.420s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['df82b6c2-9dbf-496d-b45a-0f88ada415c8', 'b16035b0-5fe8-4b71-b4df-e9cabaa1a762', 'c0dbd601-e7d7-42d9-81c9-e8ae7ac05d77', '22bcd499-9f78-4ddc-b389-92e144042e95'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:41 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:41 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-679e90bc-bbfb-4ccf-8912-757fc58b8b09-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-679e90bc-bbfb-4ccf-8912-757fc58b8b09-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:41 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.659s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-679e90bc-bbfb-4ccf-8912-757fc58b8b09" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8045417f-53f9-4ec6-8fa5-88421d6aa78a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-fc0f3bb7-55aa-45c7-9671-f277ee34f0da-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-679e90bc-bbfb-4ccf-8912-757fc58b8b09" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10f2fb-c0b5-44ac-b7f5-efd32886af5c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:41 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 Jul 08 16:32:41 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:42 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:42 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09 Jul 08 16:32:42 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:43 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-679e90bc-bbfb-4ccf-8912-757fc58b8b09" returned: 0 in 0.637s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-679e90bc-bbfb-4ccf-8912-757fc58b8b09" released by "delete_volume" :: held 1.442s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['43bee024-1cbe-4ed6-8e9a-c5438f616469', 'f7df7e52-b355-4b07-95a5-9770ca48cfdf', 'ce399a97-da70-4a20-ab1f-8fbb93cf555f', '91f11791-29f4-4849-9ad9-11e48b904d88'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:43 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:43 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-a60b38e6-64ca-427b-bde0-0f0b13d6622a-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-a60b38e6-64ca-427b-bde0-0f0b13d6622a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-a60b38e6-64ca-427b-bde0-0f0b13d6622a" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:44 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.642s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-a60b38e6-64ca-427b-bde0-0f0b13d6622a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleting offline snapshot a60b38e6-64ca-427b-bde0-0f0b13d6622a of volume 382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] snapshot_file for this snap is: volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:32:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bec59d-44a3-483c-8f90-9bd058f8a212]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ca26e21f-0fc7-41d7-a59d-a00ffbf5e4b1 tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-679e90bc-bbfb-4ccf-8912-757fc58b8b09-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:44 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a Jul 08 16:32:44 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:44 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a" returned: 0 in 0.742s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382fca13-6808-4b60-b264-c2842d5d708d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[32858f6f-4ca5-4d0e-90ba-7316a878b192]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:44 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d Jul 08 16:32:44 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:45 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d" returned: 0 in 0.738s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:45 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a Jul 08 16:32:45 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:46 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a" returned: 0 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:46 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a Jul 08 16:32:46 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:46 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d.a60b38e6-64ca-427b-bde0-0f0b13d6622a" returned: 0 in 0.651s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-a60b38e6-64ca-427b-bde0-0f0b13d6622a" released by "_delete_snapshot" :: held 2.953s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" released by "delete_snapshot" :: held 2.980s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['221877fd-dab7-44ac-bd5d-667e5bb4f106', '8fa3c912-1b11-47be-a4e7-980861b8e07d', '1e3b347e-ab86-45bc-a0db-86e424613701', '1de43199-9db6-4610-98a9-791551819084'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Delete snapshot completed successfully. Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c8c36ffa-9bd4-4aa0-86f5-efa3d303aa8b tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-a60b38e6-64ca-427b-bde0-0f0b13d6622a-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-382fca13-6808-4b60-b264-c2842d5d708d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-382fca13-6808-4b60-b264-c2842d5d708d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" acquired by "delete_volume" :: waited 0.013s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a3e41-5517-48e6-b73a-20a39a30a7c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:47 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d Jul 08 16:32:47 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:47 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d" returned: 0 in 0.730s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:48 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d Jul 08 16:32:48 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:48 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-382fca13-6808-4b60-b264-c2842d5d708d" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-quobyte-382fca13-6808-4b60-b264-c2842d5d708d" released by "delete_volume" :: held 1.440s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Created reservations ['1addb8a4-1441-4af5-90f6-89e1090e335e', '49935f6e-88e1-44b5-bc73-0254818567d2', 'ab3c6da8-3f36-4333-9ef8-e2fd41d350a9', '9dbdc619-858c-4833-ada2-429ccb4213e4'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:48 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:32:48 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:49 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:49 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:32:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Deleted volume successfully. Jul 08 16:32:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1d9ff8c9-151b-4572-95eb-22112cf2202a tempest-CreateVolumesFromSnapshotTest-119478388 None] Lock "cinder-382fca13-6808-4b60-b264-c2842d5d708d-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (4ae36dd7-6320-4db2-a192-add9cf7765f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3743c-8a6b-479f-953a-975f5f2f2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3743c-8a6b-479f-953a-975f5f2f2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044173416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e1c6ca-0795-4ad6-b201-6392b5efd9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:52Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fef2d7-d928-4842-af95-1345b4bdf7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fef2d7-d928-4842-af95-1345b4bdf7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a314bb-ccf4-4a53-a8fb-e6f6d05c06de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a314bb-ccf4-4a53-a8fb-e6f6d05c06de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e1c6ca-0795-4ad6-b201-6392b5efd9c1', 'volume_name': 'volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeb70c7-e643-437d-ae0b-6b6b46ad67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeb70c7-e643-437d-ae0b-6b6b46ad67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352653a0-7b96-4300-9243-17e41142f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume a6e1c6ca-0795-4ad6-b201-6392b5efd9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1', 'volume_size': 1} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044173416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e1c6ca-0795-4ad6-b201-6392b5efd9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:52Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:52 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:52 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 1073741824 Jul 08 16:32:52 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:52 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 1073741824" returned: 0 in 0.832s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:53 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 Jul 08 16:32:53 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:53 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" returned: 0 in 0.661s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352653a0-7b96-4300-9243-17e41142f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fba85a-ce8a-4980-9152-6b16c96f547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:53 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 (a6e1c6ca-0795-4ad6-b201-6392b5efd9c1): created successfully Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fba85a-ce8a-4980-9152-6b16c96f547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (4ae36dd7-6320-4db2-a192-add9cf7765f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3201d075-c47d-41db-9d19-b3b906aea715 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (9b0af22c-c78a-4754-8b68-535eaa9ca819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba2fe06-221a-4dbd-be28-4d187965a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba2fe06-221a-4dbd-be28-4d187965a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293116633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bad287-54da-4196-bb76-6efd95047e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b206ca-f19c-4c63-8307-90a221207454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b206ca-f19c-4c63-8307-90a221207454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92212fd8-7e65-4657-a95d-25fe37c61a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92212fd8-7e65-4657-a95d-25fe37c61a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bad287-54da-4196-bb76-6efd95047e3f', 'volume_name': 'volume-e2bad287-54da-4196-bb76-6efd95047e3f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf4a298-cdb5-4646-a0ea-4d13f630b8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf4a298-cdb5-4646-a0ea-4d13f630b8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c6f56e-96c4-44c3-8e7a-0d120359dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume e2bad287-54da-4196-bb76-6efd95047e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bad287-54da-4196-bb76-6efd95047e3f', 'volume_size': 1} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293116633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bad287-54da-4196-bb76-6efd95047e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume e2bad287-54da-4196-bb76-6efd95047e3f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:54 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:54 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f 1073741824 Jul 08 16:32:54 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (8c575532-9038-4ee7-96e1-5054dff5ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd05513-4a15-4a6c-8c9b-a0e7b78a64ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd05513-4a15-4a6c-8c9b-a0e7b78a64ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750300370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784689c4-4752-4eb8-a450-289ad2dc9090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f382982-dc83-4d5f-9007-cb8b9c94aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f382982-dc83-4d5f-9007-cb8b9c94aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c000c-46eb-476d-a0ed-3e0429b3a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c000c-46eb-476d-a0ed-3e0429b3a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784689c4-4752-4eb8-a450-289ad2dc9090', 'volume_name': 'volume-784689c4-4752-4eb8-a450-289ad2dc9090', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0587dd-80a0-4a83-84c8-88f592e501ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0587dd-80a0-4a83-84c8-88f592e501ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7ce1ce-b3dc-4abd-ae38-73b665ed16bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume 784689c4-4752-4eb8-a450-289ad2dc9090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784689c4-4752-4eb8-a450-289ad2dc9090', 'volume_size': 1} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (98857b3d-a2f7-4985-b235-f163988da296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7dc6b3-89cd-4ad6-bd6a-53764c993a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7dc6b3-89cd-4ad6-bd6a-53764c993a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823422389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8587c819-c295-4509-a43a-1cf322dcafa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b304ee-1097-47c6-9a09-271f4bca843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b304ee-1097-47c6-9a09-271f4bca843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c956590b-5208-4eee-bfd0-b983b462e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c956590b-5208-4eee-bfd0-b983b462e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8587c819-c295-4509-a43a-1cf322dcafa3', 'volume_name': 'volume-8587c819-c295-4509-a43a-1cf322dcafa3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572031c1-5dcc-4cc7-a9bb-787370db434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572031c1-5dcc-4cc7-a9bb-787370db434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3b0f1f-8dd8-4ddd-b8e8-d5eb0658500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume 8587c819-c295-4509-a43a-1cf322dcafa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8587c819-c295-4509-a43a-1cf322dcafa3', 'volume_size': 1} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (025f5711-72b5-4997-9d62-fcb53be85daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c78fb5-2a3b-4e22-a00d-f1ddf7e83693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f 1073741824" returned: 0 in 0.988s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c78fb5-2a3b-4e22-a00d-f1ddf7e83693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682173771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703bf3c-742a-429c-ba6f-70dba481617f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:56Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f704416-6e5d-4064-a89f-1163df3e92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f704416-6e5d-4064-a89f-1163df3e92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca135243-3156-406a-bf53-ad9be16e14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca135243-3156-406a-bf53-ad9be16e14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a703bf3c-742a-429c-ba6f-70dba481617f', 'volume_name': 'volume-a703bf3c-742a-429c-ba6f-70dba481617f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed08f3-30ed-486c-b79f-ae4e1037d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed08f3-30ed-486c-b79f-ae4e1037d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1fa9b1-bdc3-48a2-9213-76ab9a69ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume a703bf3c-742a-429c-ba6f-70dba481617f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a703bf3c-742a-429c-ba6f-70dba481617f', 'volume_size': 1} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:55 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f Jul 08 16:32:55 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (34109ac1-6d8f-4a47-b192-f472eca4a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e9428d-034e-408e-9df0-a8688c88aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e9428d-034e-408e-9df0-a8688c88aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603568667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f3a577-1287-4b63-a7d2-19075bf03bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:56Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404f58ca-df1d-4545-a010-264e9c98bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404f58ca-df1d-4545-a010-264e9c98bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487efbcf-6db9-48bb-8f64-5faf47734c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487efbcf-6db9-48bb-8f64-5faf47734c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f3a577-1287-4b63-a7d2-19075bf03bf5', 'volume_name': 'volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046a48c8-cb2f-4855-8cbc-0c860b1dca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046a48c8-cb2f-4855-8cbc-0c860b1dca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bb7e99-7906-438c-b5af-6d4acd12a8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume b2f3a577-1287-4b63-a7d2-19075bf03bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5', 'volume_size': 1} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:56 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f" returned: 0 in 0.682s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.710s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c6f56e-96c4-44c3-8e7a-0d120359dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bad287-54da-4196-bb76-6efd95047e3f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eefd278-5463-4d29-8f10-b0f06f1b7b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6e4fa-e85b-4db0-881d-8f9786ad1bcd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:56 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-e2bad287-54da-4196-bb76-6efd95047e3f (e2bad287-54da-4196-bb76-6efd95047e3f): created successfully Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eefd278-5463-4d29-8f10-b0f06f1b7b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:56 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (9b0af22c-c78a-4754-8b68-535eaa9ca819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c7a0719c-e552-45c9-b130-036953c90327 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:32:56 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 Jul 08 16:32:56 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:57 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98" returned: 0 in 0.775s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750300370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784689c4-4752-4eb8-a450-289ad2dc9090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume 784689c4-4752-4eb8-a450-289ad2dc9090 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:57 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:57 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 1073741824 Jul 08 16:32:57 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63', 'name': 'volume-502e4e70-c28b-43b6-b2d8-df27a3734d98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01ef8c33-ef02-418e-b96c-7ad5e8177dbe', 'enforce_multipath': True} {{(pid=87227) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 16:32:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-111d11d6-fa6d-438f-a428-3fb548c83db6 req-46fd5138-31bf-4de9-8881-18b37b48be72 tempest-TestStampPattern-448578937 None] attachment_update completed successfully. Jul 08 16:32:58 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 1073741824" returned: 0 in 0.827s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:58 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 Jul 08 16:32:58 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:58 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090" returned: 0 in 0.679s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.401s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823422389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8587c819-c295-4509-a43a-1cf322dcafa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:55Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume 8587c819-c295-4509-a43a-1cf322dcafa3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:32:58 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7ce1ce-b3dc-4abd-ae38-73b665ed16bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784689c4-4752-4eb8-a450-289ad2dc9090', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:58 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 1073741824 Jul 08 16:32:58 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49cb2c-a611-40c2-8590-3fdee0177db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:32:58 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-784689c4-4752-4eb8-a450-289ad2dc9090 (784689c4-4752-4eb8-a450-289ad2dc9090): created successfully Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49cb2c-a611-40c2-8590-3fdee0177db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:32:58 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (8c575532-9038-4ee7-96e1-5054dff5ba09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:32:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-60d22b33-976c-4834-aa58-7ffdae1c98c5 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:32:59 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 08 16:32:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 1073741824" returned: 0 in 0.822s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:32:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:32:59 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 Jul 08 16:32:59 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:00 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3" returned: 0 in 0.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.575s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682173771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703bf3c-742a-429c-ba6f-70dba481617f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:56Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume a703bf3c-742a-429c-ba6f-70dba481617f {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:00 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3b0f1f-8dd8-4ddd-b8e8-d5eb0658500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8587c819-c295-4509-a43a-1cf322dcafa3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69525f73-febb-405d-a3f2-3f10e96a31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:00 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f 1073741824 Jul 08 16:33:00 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:00 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-8587c819-c295-4509-a43a-1cf322dcafa3 (8587c819-c295-4509-a43a-1cf322dcafa3): created successfully Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69525f73-febb-405d-a3f2-3f10e96a31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (98857b3d-a2f7-4985-b235-f163988da296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-902c007e-f288-4c6c-999b-85d321c9c8f8 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:33:01 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f 1073741824" returned: 0 in 0.816s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:01 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f Jul 08 16:33:01 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:01 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f" returned: 0 in 0.664s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.729s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603568667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f3a577-1287-4b63-a7d2-19075bf03bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62440a8de7d4aeab3545a1faa6cc52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:32:56Z,use_quota=True,user_id='bbe259ca1c1e4b109ce4d0fa7b55c234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Creating volume b2f3a577-1287-4b63-a7d2-19075bf03bf5 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:01 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1fa9b1-bdc3-48a2-9213-76ab9a69ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a703bf3c-742a-429c-ba6f-70dba481617f', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:01 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 1073741824 Jul 08 16:33:01 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa3f0bd-1bd5-45f3-9835-48ce923d1477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-a703bf3c-742a-429c-ba6f-70dba481617f (a703bf3c-742a-429c-ba6f-70dba481617f): created successfully Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa3f0bd-1bd5-45f3-9835-48ce923d1477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (025f5711-72b5-4997-9d62-fcb53be85daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2ce1146e-8b40-4175-877e-0e9126f045c1 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:33:02 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 1073741824" returned: 0 in 0.860s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:02 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 Jul 08 16:33:02 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:03 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5" returned: 0 in 0.658s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bb7e99-7906-438c-b5af-6d4acd12a8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5cf032-b34f-4fdd-85b2-7adac9d5629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Volume volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 (b2f3a577-1287-4b63-a7d2-19075bf03bf5): created successfully Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5cf032-b34f-4fdd-85b2-7adac9d5629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Flow 'volume_create_manager' (34109ac1-6d8f-4a47-b192-f472eca4a01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2f69833d-154c-4c86-9472-f9f73f2f575c tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created volume successfully. Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-b2f3a577-1287-4b63-a7d2-19075bf03bf5-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-b2f3a577-1287-4b63-a7d2-19075bf03bf5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-b2f3a577-1287-4b63-a7d2-19075bf03bf5" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-b2f3a577-1287-4b63-a7d2-19075bf03bf5" acquired by "delete_volume" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a8909-ce34-4f47-81f1-fc79dfa14b75]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:03 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 Jul 08 16:33:03 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [req-59ea67c8-a3c4-420e-ba8b-54aa737b6595 req-ae61a48c-5706-4af3-a8ad-4c933e9e8269 tempest-TestStampPattern-448578937 None] Terminate volume connection completed successfully. Jul 08 16:33:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [req-59ea67c8-a3c4-420e-ba8b-54aa737b6595 req-ae61a48c-5706-4af3-a8ad-4c933e9e8269 tempest-TestStampPattern-448578937 None] Deleting attachment 01ef8c33-ef02-418e-b96c-7ad5e8177dbe. {{(pid=87227) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 16:33:04 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5" returned: 0 in 0.785s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:04 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5 Jul 08 16:33:04 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:05 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2f3a577-1287-4b63-a7d2-19075bf03bf5" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-b2f3a577-1287-4b63-a7d2-19075bf03bf5" released by "delete_volume" :: held 1.476s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['63bc13b4-ba64-4fbe-ba1b-c8cc679546c2', '6a3c881f-d7f8-4e09-9665-e481a64d64ca', 'ec012d37-43a7-4d17-8ecf-10405535b435', 'e6b5ce49-9035-44fe-9507-5322bc61656c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:05 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:05 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-a703bf3c-742a-429c-ba6f-70dba481617f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-a703bf3c-742a-429c-ba6f-70dba481617f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-a703bf3c-742a-429c-ba6f-70dba481617f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-a703bf3c-742a-429c-ba6f-70dba481617f" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:05 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a242e1-0b7b-4117-9b6d-2de0d98a8532]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-04f4b850-7bb4-463d-be1c-7924329048b9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-b2f3a577-1287-4b63-a7d2-19075bf03bf5-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:06 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f Jul 08 16:33:06 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:06 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f" returned: 0 in 0.802s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:06 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f Jul 08 16:33:06 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:07 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a703bf3c-742a-429c-ba6f-70dba481617f" returned: 0 in 0.709s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-a703bf3c-742a-429c-ba6f-70dba481617f" released by "delete_volume" :: held 1.564s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['579e9ab5-d63d-4450-bbef-a4a1e241b3b8', 'ca60a88c-b100-445f-8a53-ee7bd4719905', 'b1e697b5-ff91-450c-b6ac-52fe6ebd3e46', '21322fc1-03ab-4a48-a53c-722dd8b6a2ba'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:07 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:07 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-8587c819-c295-4509-a43a-1cf322dcafa3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-8587c819-c295-4509-a43a-1cf322dcafa3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-8587c819-c295-4509-a43a-1cf322dcafa3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-8587c819-c295-4509-a43a-1cf322dcafa3" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd86b0-d49f-4e5c-b70c-7638037bc1aa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:08 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 Jul 08 16:33:08 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:08 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.735s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5dff9702-022b-49ab-be7f-9fe067564f74 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-a703bf3c-742a-429c-ba6f-70dba481617f-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:09 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3" returned: 0 in 0.885s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:09 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3 Jul 08 16:33:09 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:09 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8587c819-c295-4509-a43a-1cf322dcafa3" returned: 0 in 0.689s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-8587c819-c295-4509-a43a-1cf322dcafa3" released by "delete_volume" :: held 1.619s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['ac8811ff-8b4e-4322-b07f-af18b7de36b8', '8cb068e3-ac03-4eb5-a3b7-dc1feb084720', '571bf9c5-d820-4953-8a6a-9139092ea01d', '2367bc25-1c45-4737-9d77-253daabd66fb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:10 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:10 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-784689c4-4752-4eb8-a450-289ad2dc9090-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-784689c4-4752-4eb8-a450-289ad2dc9090-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-784689c4-4752-4eb8-a450-289ad2dc9090" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-784689c4-4752-4eb8-a450-289ad2dc9090" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e2054-47f4-4b6a-9b18-c0ba70ea3fcd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:10 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 Jul 08 16:33:10 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:10 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-e601c7ee-b3d7-4a78-8c1b-b83e552a8784 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-8587c819-c295-4509-a43a-1cf322dcafa3-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:11 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:11 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090 Jul 08 16:33:11 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:11 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-784689c4-4752-4eb8-a450-289ad2dc9090" returned: 0 in 0.679s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-784689c4-4752-4eb8-a450-289ad2dc9090" released by "delete_volume" :: held 1.515s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['09ced3dc-75d1-44b0-86a1-c7399c68204f', '252e5231-3389-4367-af1c-70de89e9bd74', 'ce36a4f8-924d-4c9f-9f41-edd15d31131a', '6bfb2cda-bd60-4439-a8ea-521f26f69621'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:12 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:12 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-e2bad287-54da-4196-bb76-6efd95047e3f-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-e2bad287-54da-4196-bb76-6efd95047e3f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-e2bad287-54da-4196-bb76-6efd95047e3f" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-e2bad287-54da-4196-bb76-6efd95047e3f" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865d2c1-c3ee-48e0-8262-819f1fe6f92d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:12 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cfc311d6-50df-41e2-b4fd-2e31052315f9 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-784689c4-4752-4eb8-a450-289ad2dc9090-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:12 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f Jul 08 16:33:12 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:13 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f" returned: 0 in 0.781s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:13 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f Jul 08 16:33:13 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-502e4e70-c28b-43b6-b2d8-df27a3734d98-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "cinder-502e4e70-c28b-43b6-b2d8-df27a3734d98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3ebee-37b4-41d2-b769-df55b6665ec5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:14 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 Jul 08 16:33:14 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:14 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-e2bad287-54da-4196-bb76-6efd95047e3f" returned: 0 in 0.665s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-e2bad287-54da-4196-bb76-6efd95047e3f" released by "delete_volume" :: held 1.512s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['793bc3f7-3d52-4973-9eb8-21d25b44d474', '26bb7d5d-0518-474c-9738-e2a6e9bedb4c', '445e26b3-4736-4485-88ef-822ca51495ad', '39eed350-f4c6-4cda-941b-07ee20630d77'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:14 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:14 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:14 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98" returned: 0 in 0.775s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:14 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98 Jul 08 16:33:14 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "cinder-quobyte-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c842b2f-2123-4c76-853b-8207542cca02]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:15 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.694s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28e374d8-1f39-4c9a-b0e1-dfb8f840b362 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-e2bad287-54da-4196-bb76-6efd95047e3f-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:15 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 Jul 08 16:33:15 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:15 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-502e4e70-c28b-43b6-b2d8-df27a3734d98" returned: 0 in 0.701s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-502e4e70-c28b-43b6-b2d8-df27a3734d98" released by "delete_volume" :: held 1.515s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=102,cinder:UPDATE=137,cinder:INSERT=31,cinder:DELETE=14 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=94,cinder:UPDATE=131,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Created reservations ['8845ba6e-0d69-4fa2-8d0d-1a488b28f794', 'd3a84afc-3de8-49b6-a82f-503e2dd8b481', '91b919fd-8827-4b2b-8ebb-06ef4ef22c47', 'e9f48128-69df-49b6-9cdc-f45f65c5ac3a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:15 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:15 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:15 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" returned: 0 in 0.802s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:15 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1 Jul 08 16:33:15 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:16 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.676s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Deleted volume successfully. Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c7e62da-6c38-4a84-99a6-3409a01eb950 tempest-TestStampPattern-448578937 None] Lock "cinder-502e4e70-c28b-43b6-b2d8-df27a3734d98-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:16 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-quobyte-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1" released by "delete_volume" :: held 1.555s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Deleting offline snapshot 0983e07f-6ffd-482c-a4dd-e3c79bf00deb of volume 38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] snapshot_file for this snap is: volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0785a-2bc4-4801-ad35-4e8ee96a5adb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Created reservations ['7cde258a-2f3b-4a92-ac4c-4d754c509477', 'db2b8101-f1e6-40f5-9d24-5d8592735f51', '0055311b-5b31-4b35-812b-4a05d1384615', 'f7166fac-9ad1-42f9-94a1-4a04c385026c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:16 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:33:16 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:16 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:16 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:17 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:17 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.684s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.796s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38099f3e-4e3c-401b-aa2f-67444bda3314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:33:17 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Deleted volume successfully. Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad26bd-107e-4329-b68e-2c5a8440d6f5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f9b8cfe1-de6d-4bef-8a2a-271681bb79a0 tempest-CreateVolumesFromSourceVolumeTest-1625643826 None] Lock "cinder-a6e1c6ca-0795-4ad6-b201-6392b5efd9c1-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:17 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:33:17 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:18 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.813s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:18 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:33:18 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:18 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:19 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb Jul 08 16:33:19 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:19 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:19 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:19 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314.0983e07f-6ffd-482c-a4dd-e3c79bf00deb" returned: 0 in 0.699s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-0983e07f-6ffd-482c-a4dd-e3c79bf00deb" released by "_delete_snapshot" :: held 3.197s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" released by "delete_snapshot" :: held 3.224s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Created reservations ['e218fde4-f5dc-41e2-85b7-747263f25152', '1a01438c-9cb3-416b-a76a-575b0575963e', 'd513dfc6-8278-45c1-97b5-f03d62dd09e7', 'cb7cd754-f2fc-42d6-9787-633f149c7ac2'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Delete snapshot completed successfully. Jul 08 16:33:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-aebad1db-db77-4998-9b96-c199c79f07e9 tempest-TestStampPattern-448578937 None] Lock "cinder-0983e07f-6ffd-482c-a4dd-e3c79bf00deb-delete_snapshot" released by "delete_snapshot" :: held 3.392s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:20 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.681s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:33:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:33:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-38099f3e-4e3c-401b-aa2f-67444bda3314-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "cinder-38099f3e-4e3c-401b-aa2f-67444bda3314-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Acquiring lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72e2d6-77c3-4ca8-a2a6-cfe6448203db]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:29 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:33:29 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:30 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:30 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314 Jul 08 16:33:30 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:30 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-38099f3e-4e3c-401b-aa2f-67444bda3314" returned: 0 in 0.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "cinder-quobyte-38099f3e-4e3c-401b-aa2f-67444bda3314" released by "delete_volume" :: held 1.460s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Created reservations ['8ec720d5-9b04-4a6b-8c11-488dc46debed', '98a5400a-df98-4760-ac3b-e900da9a7a73', '875c85e9-fcd1-4608-9831-bf8338e1f259', 'c57237a9-3bb2-4660-bf74-b21779a4b295'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:30 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:30 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:31 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.650s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:31 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Deleted volume successfully. Jul 08 16:33:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-49d8bfcd-412e-4e32-ac4a-8f2450b18a44 tempest-TestStampPattern-448578937 None] Lock "cinder-38099f3e-4e3c-401b-aa2f-67444bda3314-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:40 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=7,cinder:UPDATE=29,cinder:SELECT=13,cinder:DELETE=2 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (feb6dcff-0ae5-4a5e-96c7-9b24b10b3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b584ec1-df78-40cd-b62e-51f5d602a9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b584ec1-df78-40cd-b62e-51f5d602a9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118321414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8c7dca-fcab-456d-bbb9-e4717b52d7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:41Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fee7a9-99ed-4da2-bd47-96f3ba8bf639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fee7a9-99ed-4da2-bd47-96f3ba8bf639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e77b578-653c-48e8-9cdc-b7be8d70a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e77b578-653c-48e8-9cdc-b7be8d70a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8c7dca-fcab-456d-bbb9-e4717b52d7ca', 'volume_name': 'volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c47a4dd-6439-4050-b596-6c4a3b370f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c47a4dd-6439-4050-b596-6c4a3b370f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b3e8e-d85d-4f6a-b75c-e958636ae73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Volume dd8c7dca-fcab-456d-bbb9-e4717b52d7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca', 'volume_size': 1} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118321414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8c7dca-fcab-456d-bbb9-e4717b52d7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:41Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Creating volume dd8c7dca-fcab-456d-bbb9-e4717b52d7ca {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:41 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:41 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca 1073741824 Jul 08 16:33:41 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (c04d35db-128a-45f3-8221-d2b29b4537f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3004c3e-aca5-46b3-8591-2a72e1615011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3004c3e-aca5-46b3-8591-2a72e1615011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977560175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bef7c4-c1ef-402d-b288-d2696392fbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:41Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b11140b-7ed8-4914-9336-26c5d67c933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b11140b-7ed8-4914-9336-26c5d67c933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754c1e2-1ff8-4ee5-9bda-2e29be88787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754c1e2-1ff8-4ee5-9bda-2e29be88787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bef7c4-c1ef-402d-b288-d2696392fbb5', 'volume_name': 'volume-99bef7c4-c1ef-402d-b288-d2696392fbb5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffdf1c3-d646-43c9-82a9-d58fd6db387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffdf1c3-d646-43c9-82a9-d58fd6db387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda8b0e-fedd-47bb-ab15-0ef0a68836d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Volume 99bef7c4-c1ef-402d-b288-d2696392fbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bef7c4-c1ef-402d-b288-d2696392fbb5', 'volume_size': 1} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (ab8ce4ff-f9b2-468c-b9b0-a2ac736c2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb3ce61-8080-414e-977d-56e35451ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb3ce61-8080-414e-977d-56e35451ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924756657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b99f475-2335-4b47-afcb-9dce96d193d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:42Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa1a3c-fd72-47f7-a9f3-0903a0f69370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa1a3c-fd72-47f7-a9f3-0903a0f69370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2483b33-3337-4a6b-b355-cee1cd501b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2483b33-3337-4a6b-b355-cee1cd501b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b99f475-2335-4b47-afcb-9dce96d193d3', 'volume_name': 'volume-4b99f475-2335-4b47-afcb-9dce96d193d3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3220ea-96ac-4135-95ba-50b3d99c2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3220ea-96ac-4135-95ba-50b3d99c2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258e66d0-dbf6-4e16-8258-4ddf8a445f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Volume 4b99f475-2335-4b47-afcb-9dce96d193d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b99f475-2335-4b47-afcb-9dce96d193d3', 'volume_size': 1} Jul 08 16:33:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:42 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca 1073741824" returned: 0 in 0.930s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:42 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca Jul 08 16:33:42 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (0c28e779-cf76-484f-ae1b-bb238b1914eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87f9b09-6b10-4dcd-ab59-e5a8f4e7cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87f9b09-6b10-4dcd-ab59-e5a8f4e7cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140001551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a33ce2-ed35-4bd2-a05a-d2c4bd81c387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:42Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5a9de2-7ccf-4115-bdc1-70f5aac38ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5a9de2-7ccf-4115-bdc1-70f5aac38ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1c30ab-5efb-488b-8e5b-99d4d75d486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1c30ab-5efb-488b-8e5b-99d4d75d486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a33ce2-ed35-4bd2-a05a-d2c4bd81c387', 'volume_name': 'volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b78bfad-7d21-44c8-b12e-53b5b2b8997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b78bfad-7d21-44c8-b12e-53b5b2b8997f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2fe6ee-9ad2-44dc-8626-fdfd4c75777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Volume 13a33ce2-ed35-4bd2-a05a-d2c4bd81c387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387', 'volume_size': 1} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (130dc0b7-4edc-45c6-8854-11c46caa693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc0f8f7-3494-485c-8c6d-ff546e3f2b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc0f8f7-3494-485c-8c6d-ff546e3f2b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197823318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0803948c-c836-4465-9305-cf4631cfb672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:43Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd28bd2-37fd-4aad-9d7e-10badc506f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd28bd2-37fd-4aad-9d7e-10badc506f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f9e2df-7dd6-4575-b8c4-abfbddd3d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f9e2df-7dd6-4575-b8c4-abfbddd3d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0803948c-c836-4465-9305-cf4631cfb672', 'volume_name': 'volume-0803948c-c836-4465-9305-cf4631cfb672', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6ae55-c070-4ced-bf38-81a699d3e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6ae55-c070-4ced-bf38-81a699d3e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5e72d6-2c6a-43c6-84ec-62bb3b4051bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Volume 0803948c-c836-4465-9305-cf4631cfb672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0803948c-c836-4465-9305-cf4631cfb672', 'volume_size': 1} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:42 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" returned: 0 in 0.688s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977560175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bef7c4-c1ef-402d-b288-d2696392fbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:41Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Creating volume 99bef7c4-c1ef-402d-b288-d2696392fbb5 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:42 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:42 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 1073741824 Jul 08 16:33:42 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b3e8e-d85d-4f6a-b75c-e958636ae73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153ec35a-afbc-4736-b785-4ac0888550bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Volume volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca (dd8c7dca-fcab-456d-bbb9-e4717b52d7ca): created successfully Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153ec35a-afbc-4736-b785-4ac0888550bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (feb6dcff-0ae5-4a5e-96c7-9b24b10b3d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1e3d4074-f873-47cd-b378-c43002709afa tempest-CreateVolumesFromImageTest-1270338211 None] Created volume successfully. Jul 08 16:33:43 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 1073741824" returned: 0 in 0.825s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:43 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 Jul 08 16:33:43 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:44 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5" returned: 0 in 0.631s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.424s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924756657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b99f475-2335-4b47-afcb-9dce96d193d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:42Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Creating volume 4b99f475-2335-4b47-afcb-9dce96d193d3 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:44 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda8b0e-fedd-47bb-ab15-0ef0a68836d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bef7c4-c1ef-402d-b288-d2696392fbb5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3088cfb-a5ae-4d9b-8936-9cb617fe9c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:44 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 1073741824 Jul 08 16:33:44 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:44 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Volume volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 (99bef7c4-c1ef-402d-b288-d2696392fbb5): created successfully Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3088cfb-a5ae-4d9b-8936-9cb617fe9c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (c04d35db-128a-45f3-8221-d2b29b4537f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-76460dc0-7f6c-4c26-8df6-fe77904b805c tempest-CreateVolumesFromImageTest-1270338211 None] Created volume successfully. Jul 08 16:33:45 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 1073741824" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:45 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 Jul 08 16:33:45 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:45 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3" returned: 0 in 0.670s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140001551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a33ce2-ed35-4bd2-a05a-d2c4bd81c387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:42Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Creating volume 13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:45 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258e66d0-dbf6-4e16-8258-4ddf8a445f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b99f475-2335-4b47-afcb-9dce96d193d3', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:45 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 1073741824 Jul 08 16:33:45 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87f50e6-8d86-42d5-9efc-dc4e07f38b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Volume volume-4b99f475-2335-4b47-afcb-9dce96d193d3 (4b99f475-2335-4b47-afcb-9dce96d193d3): created successfully Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87f50e6-8d86-42d5-9efc-dc4e07f38b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (ab8ce4ff-f9b2-468c-b9b0-a2ac736c2d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:45 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-da1e9c76-536f-4b39-afc5-778d9a7a0edc tempest-CreateVolumesFromImageTest-1270338211 None] Created volume successfully. Jul 08 16:33:46 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 1073741824" returned: 0 in 0.801s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:46 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 Jul 08 16:33:46 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:47 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" returned: 0 in 0.651s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.696s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197823318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0803948c-c836-4465-9305-cf4631cfb672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4eca4928d6430687dfcc1b63630508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:33:43Z,use_quota=True,user_id='ded22620861b43bdb67868912b698b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Creating volume 0803948c-c836-4465-9305-cf4631cfb672 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:33:47 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2fe6ee-9ad2-44dc-8626-fdfd4c75777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:47 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 1073741824 Jul 08 16:33:47 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551d771a-617f-4227-a1c6-8175f4063e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Volume volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 (13a33ce2-ed35-4bd2-a05a-d2c4bd81c387): created successfully Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551d771a-617f-4227-a1c6-8175f4063e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (0c28e779-cf76-484f-ae1b-bb238b1914eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f9420844-3678-4831-895c-2ccd23de19c8 tempest-CreateVolumesFromImageTest-1270338211 None] Created volume successfully. Jul 08 16:33:48 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 1073741824" returned: 0 in 0.822s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:48 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 Jul 08 16:33:48 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:48 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672" returned: 0 in 0.631s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5e72d6-2c6a-43c6-84ec-62bb3b4051bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0803948c-c836-4465-9305-cf4631cfb672', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5756d074-43dd-4e3e-bbc9-950aa2f1633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:33:48 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Volume volume-0803948c-c836-4465-9305-cf4631cfb672 (0803948c-c836-4465-9305-cf4631cfb672): created successfully Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5756d074-43dd-4e3e-bbc9-950aa2f1633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:33:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Flow 'volume_create_manager' (130dc0b7-4edc-45c6-8854-11c46caa693b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:33:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e26bf895-42ab-4fea-8b21-bb53078792db tempest-CreateVolumesFromImageTest-1270338211 None] Created volume successfully. Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-0803948c-c836-4465-9305-cf4631cfb672-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-0803948c-c836-4465-9305-cf4631cfb672-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-quobyte-0803948c-c836-4465-9305-cf4631cfb672" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-0803948c-c836-4465-9305-cf4631cfb672" acquired by "delete_volume" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d5784a-d22c-4ef2-82d2-ac75a1c447b4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:49 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 Jul 08 16:33:49 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:49 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672" returned: 0 in 0.742s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:49 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672 Jul 08 16:33:49 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:50 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0803948c-c836-4465-9305-cf4631cfb672" returned: 0 in 0.635s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-0803948c-c836-4465-9305-cf4631cfb672" released by "delete_volume" :: held 1.415s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Created reservations ['6f012642-314f-4cc0-8cab-885aa9d49b46', '5dd4c14b-05c7-4d05-ac0d-eaeba544d3bd', '083392a1-615d-4efc-a1c8-01fdb24ec921', '930f4159-c36a-441d-9e50-9d77ad2fa1cf'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:50 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:50 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:51 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Deleted volume successfully. Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-221f21bf-f178-4c1d-84fb-fef2730e04d2 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-0803948c-c836-4465-9305-cf4631cfb672-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-quobyte-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" acquired by "delete_volume" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c952c33-cbf6-4230-bcee-fc07abcebf3c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:51 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 Jul 08 16:33:51 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:52 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:52 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387 Jul 08 16:33:52 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:53 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" returned: 0 in 0.634s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387" released by "delete_volume" :: held 1.428s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Created reservations ['d29a60fc-f9d1-412d-a145-94ee0a7b453f', '7a1473a7-6b1a-41c2-8ad7-1da2a361498a', 'c59ae269-660f-4807-97c5-30abdd9376eb', 'd7cda83c-626b-4bce-b9ad-da48e565035d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:53 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:53 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-4b99f475-2335-4b47-afcb-9dce96d193d3-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-4b99f475-2335-4b47-afcb-9dce96d193d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-quobyte-4b99f475-2335-4b47-afcb-9dce96d193d3" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:53 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.686s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-4b99f475-2335-4b47-afcb-9dce96d193d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Deleted volume successfully. Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e983fb-c5f0-4d97-b586-d33d8e66bd30]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-7d64ee1e-0133-42e9-b942-ba3e33ff491e tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-13a33ce2-ed35-4bd2-a05a-d2c4bd81c387-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:53 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 Jul 08 16:33:53 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:54 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3" returned: 0 in 0.743s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:54 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3 Jul 08 16:33:54 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:55 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4b99f475-2335-4b47-afcb-9dce96d193d3" returned: 0 in 0.645s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-4b99f475-2335-4b47-afcb-9dce96d193d3" released by "delete_volume" :: held 1.432s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Created reservations ['f5c675f1-8a8f-4e35-b680-1efa64f29ee3', '13259f52-83a3-472d-ada0-ffdc95d12c64', 'c3dc3d37-984c-4113-b283-1f2759098f4f', 'ce5e51d5-dbca-432b-92a1-e4fa86ac91f2'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:55 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:55 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-99bef7c4-c1ef-402d-b288-d2696392fbb5-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:56 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-99bef7c4-c1ef-402d-b288-d2696392fbb5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Deleted volume successfully. Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-652b63f2-f233-4fba-bef1-689dc062d3d5 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-4b99f475-2335-4b47-afcb-9dce96d193d3-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-quobyte-99bef7c4-c1ef-402d-b288-d2696392fbb5" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-99bef7c4-c1ef-402d-b288-d2696392fbb5" acquired by "delete_volume" :: waited 0.013s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d58298-8da7-4e85-9cdc-41e7550c5608]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:56 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 Jul 08 16:33:56 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:56 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5" returned: 0 in 0.731s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:56 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5 Jul 08 16:33:56 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:57 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bef7c4-c1ef-402d-b288-d2696392fbb5" returned: 0 in 0.621s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-99bef7c4-c1ef-402d-b288-d2696392fbb5" released by "delete_volume" :: held 1.389s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Created reservations ['cdd7043a-d4bd-418e-95bf-d3c5771ad424', '52332b50-1976-4c70-826d-c73c3e93d0a6', 'd810117e-a4ab-4688-ab41-f17ed1b1166b', '84f00ecc-9fc7-4167-a3f5-f098f1c8e5e5'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:57 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:57 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:58 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.627s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:33:58 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Deleted volume successfully. Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5c6fc0ed-da95-4e22-86ed-378a2ea3e1f3 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-99bef7c4-c1ef-402d-b288-d2696392fbb5-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "cinder-quobyte-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab279a1-e104-43ac-8dea-35de1a6584e0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:33:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:58 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca Jul 08 16:33:58 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:59 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" returned: 0 in 0.731s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:59 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca Jul 08 16:33:59 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:33:59 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" returned: 0 in 0.635s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-quobyte-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca" released by "delete_volume" :: held 1.409s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Created reservations ['751f10bd-8c2f-4f50-ba2e-17b698320aa2', '32feaae9-02eb-4e8d-9085-607844358207', 'e8584340-488a-4bb8-9c06-0edd849af51f', 'dd6fce97-e8e8-41fc-9cea-2090e3dcbfab'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:33:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:33:59 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:33:59 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:00 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.628s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:00 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Deleted volume successfully. Jul 08 16:34:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4c6c81c7-558a-4ca7-be9b-36bfe4b52856 tempest-CreateVolumesFromImageTest-1270338211 None] Lock "cinder-dd8c7dca-fcab-456d-bbb9-e4717b52d7ca-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Flow 'volume_create_manager' (50403e32-54be-446e-a3e9-6c88bbe41e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91c2b21-7692-47bc-b8ec-c35aac17a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91c2b21-7692-47bc-b8ec-c35aac17a279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea746d53-bf7d-41af-beae-8cb0d1a5ab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4aff131742e4c8f9cc9db5340a0937a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:05Z,use_quota=True,user_id='1bd738b6714745c6b72ffe581f696ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712285bf-0274-4a96-b17b-3ad63f362be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712285bf-0274-4a96-b17b-3ad63f362be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d22cae7-f9dc-4325-8a0b-50010605c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d22cae7-f9dc-4325-8a0b-50010605c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea746d53-bf7d-41af-beae-8cb0d1a5ab52', 'volume_name': 'volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52', 'volume_size': 1, 'image_id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d6c572c9001a7d87dc896cdfdc596ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4aff131742e4c8f9cc9db5340a0937a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '931f6ea3f22a9bd81708e1ca0c0ba6101457519dda84f4f43f0f870427309b0b29b2331c5e1530a366c068458b5f95e04405c817ba42af496ec1776d2b91f8f4', 'id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff756d80-15b0-4a5f-bd07-5b6adac68712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff756d80-15b0-4a5f-bd07-5b6adac68712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7ee1c-e87f-4695-9f4b-0efcff8c88b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52', 'volume_size': 1, 'image_id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d6c572c9001a7d87dc896cdfdc596ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4aff131742e4c8f9cc9db5340a0937a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '931f6ea3f22a9bd81708e1ca0c0ba6101457519dda84f4f43f0f870427309b0b29b2331c5e1530a366c068458b5f95e04405c817ba42af496ec1776d2b91f8f4', 'id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c/file', 'properties': {}}, 'image_service': } Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Trying to clone ea746d53-bf7d-41af-beae-8cb0d1a5ab52 from image b81421ec-5c0e-45fe-8c85-af34f5bd879c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:34:05 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Image download 0.00 MB at 0.00 MB/s Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3145ed-a6bc-4803-85ab-13d69fbe141d]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:05 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:05 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:06 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:06 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:06 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:06 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 1 in 0.695s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:06 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Temporary image b81421ec-5c0e-45fe-8c85-af34f5bd879c is fetched for user 1bd738b6714745c6b72ffe581f696ffe. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:34:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[927846ce-fe58-496d-9265-f863b114c839]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:07 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:07 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:07 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:07 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:07 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:08 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 1 in 0.713s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea746d53-bf7d-41af-beae-8cb0d1a5ab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4aff131742e4c8f9cc9db5340a0937a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:05Z,use_quota=True,user_id='1bd738b6714745c6b72ffe581f696ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Creating volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:08 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:08 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1073741824 Jul 08 16:34:08 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:09 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1073741824" returned: 0 in 0.783s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:09 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:09 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:09 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 0 in 0.614s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Attempting download of b81421ec-5c0e-45fe-8c85-af34f5bd879c ((None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}])) to volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af8af4-304a-4fab-a9af-94d08543a83b]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:10 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v Jul 08 16:34:10 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:10 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:10 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v Jul 08 16:34:10 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:11 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v" returned: 1 in 0.709s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b81421ec-5c0e-45fe-8c85-af34f5bd879c_iv559o3v' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0f45d-1cd7-4a32-8409-b20a1ba4e5c7]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:11 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:11 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:12 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:12 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD Jul 08 16:34:12 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:12 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD" returned: 1 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] b81421ec-5c0e-45fe-8c85-af34f5bd879c was raw, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:34:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:12 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:12 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:13 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 0 in 0.704s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:13 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b81421ec-5c0e-45fe-8c85-af34f5bd879c_78c1f5qbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:34:13 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 16:34:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:13 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1G Jul 08 16:34:13 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:14 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 1G" returned: 0 in 0.662s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[797341de-76e5-468a-8268-1495ded5e94e]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:14 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:14 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:14 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 0 in 0.708s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:15 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:15 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:15 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 1 in 0.725s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Downloaded image b81421ec-5c0e-45fe-8c85-af34f5bd879c ((None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}])) to volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Temporary image b81421ec-5c0e-45fe-8c85-af34f5bd879c for user 1bd738b6714745c6b72ffe581f696ffe is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Marking volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Copying metadata from image b81421ec-5c0e-45fe-8c85-af34f5bd879c to ea746d53-bf7d-41af-beae-8cb0d1a5ab52. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Creating volume glance metadata for volume ea746d53-bf7d-41af-beae-8cb0d1a5ab52 backed by image b81421ec-5c0e-45fe-8c85-af34f5bd879c with: {'image_id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0d6c572c9001a7d87dc896cdfdc596ba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7ee1c-e87f-4695-9f4b-0efcff8c88b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52', 'volume_size': 1, 'image_id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d6c572c9001a7d87dc896cdfdc596ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4aff131742e4c8f9cc9db5340a0937a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '931f6ea3f22a9bd81708e1ca0c0ba6101457519dda84f4f43f0f870427309b0b29b2331c5e1530a366c068458b5f95e04405c817ba42af496ec1776d2b91f8f4', 'id': 'b81421ec-5c0e-45fe-8c85-af34f5bd879c', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b81421ec-5c0e-45fe-8c85-af34f5bd879c/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbcc286-e912-474d-9aec-0d84aa46ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Volume volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 (ea746d53-bf7d-41af-beae-8cb0d1a5ab52): created successfully Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbcc286-e912-474d-9aec-0d84aa46ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Flow 'volume_create_manager' (50403e32-54be-446e-a3e9-6c88bbe41e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:15 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-95d50127-999d-450a-9884-6c3622b21fa2 tempest-VolumeImageDependencyTests-1113957987 None] Created volume successfully. Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Acquiring lock "cinder-ea746d53-bf7d-41af-beae-8cb0d1a5ab52-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "cinder-ea746d53-bf7d-41af-beae-8cb0d1a5ab52-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Acquiring lock "cinder-quobyte-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "cinder-quobyte-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ac122-6c4b-47b6-86e3-c5d1bdb206bb]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:17 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:17 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:17 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 0 in 0.729s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:17 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:17 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:18 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 1 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:18 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52 Jul 08 16:34:18 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:19 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" returned: 0 in 0.647s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "cinder-quobyte-ea746d53-bf7d-41af-beae-8cb0d1a5ab52" released by "delete_volume" :: held 2.159s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Created reservations ['b4ddb217-2f49-4f0e-91c4-1d70e8034d07', '3f2c9d1f-d014-4f1c-93d0-147e08c812fe', '31f67b13-2b79-479e-afed-7579bd76ef56', '4b640ad5-1cd2-4332-886f-20a507bee818'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:19 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:19 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:19 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:19 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.634s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Deleted volume successfully. Jul 08 16:34:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-cae679e4-cafb-41e7-80a6-f73a5c548f9a tempest-VolumeImageDependencyTests-1113957987 None] Lock "cinder-ea746d53-bf7d-41af-beae-8cb0d1a5ab52-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:20 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.633s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:34:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:34:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:34:29 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=71,cinder:SELECT=45,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:34:29 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=6,cinder:UPDATE=13,cinder:SELECT=4,cinder:DELETE=1 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (5074984f-e1f1-4fd0-b01e-b0755b3e1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4aaa34-422f-49b5-a718-ac711a56da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4aaa34-422f-49b5-a718-ac711a56da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477061017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7d6803-e5af-4a05-858d-baeeda292c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7d6803-e5af-4a05-858d-baeeda292c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbce4448-fd7e-4288-b590-a3643cec2409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbce4448-fd7e-4288-b590-a3643cec2409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4', 'volume_name': 'volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e452c611-4bbb-4002-8f93-e9e1328ca369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e452c611-4bbb-4002-8f93-e9e1328ca369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b80dd-9c4d-4ce7-8c42-021c8ac4f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4', 'volume_size': 1} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477061017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:32 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:32 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 1073741824 Jul 08 16:34:32 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (b274eda7-7460-41fc-8596-892a71063870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131fa295-ece0-4fa5-967a-add6c92de5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131fa295-ece0-4fa5-967a-add6c92de5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120630066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4d0560-bda2-4ece-b40d-821facc42e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f468a17-b153-450c-973f-7fafefd81696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f468a17-b153-450c-973f-7fafefd81696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfdfb80-fb76-4776-ba6e-67312bc94694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfdfb80-fb76-4776-ba6e-67312bc94694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4d0560-bda2-4ece-b40d-821facc42e70', 'volume_name': 'volume-8d4d0560-bda2-4ece-b40d-821facc42e70', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839c5a6f-30ee-46e3-80eb-061263bed8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839c5a6f-30ee-46e3-80eb-061263bed8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8a0546-22d8-4fb1-b5e4-e76955931909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 8d4d0560-bda2-4ece-b40d-821facc42e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4d0560-bda2-4ece-b40d-821facc42e70', 'volume_size': 1} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (6d3ded86-9f69-4414-be4c-0635741e3553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5714d455-ec0e-409c-80c1-e4d637add54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5714d455-ec0e-409c-80c1-e4d637add54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170768669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71a360d-5563-4834-bfc2-2ea53fb1f403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb61e825-c7a0-4811-904d-4d4aa6cb34b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb61e825-c7a0-4811-904d-4d4aa6cb34b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2340cc9-5368-4f5a-935a-d5319efa44cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2340cc9-5368-4f5a-935a-d5319efa44cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71a360d-5563-4834-bfc2-2ea53fb1f403', 'volume_name': 'volume-b71a360d-5563-4834-bfc2-2ea53fb1f403', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c34dc0-ce68-49ad-b831-0383daa98368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c34dc0-ce68-49ad-b831-0383daa98368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d164b35-a9c8-45ea-a451-2431a889cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Volume b71a360d-5563-4834-bfc2-2ea53fb1f403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71a360d-5563-4834-bfc2-2ea53fb1f403', 'volume_size': 1} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (813f1006-a462-452f-a5f3-e09b02345430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b5577c-d6d6-487e-8194-177a1e577f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b5577c-d6d6-487e-8194-177a1e577f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989127993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399073ef-8f22-47f2-a9bc-0feceb7969ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:33Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7796118b-aa31-44b0-a126-6ada0f76b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7796118b-aa31-44b0-a126-6ada0f76b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0786f1d-60f3-4ccb-ba9a-95c8bb33ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0786f1d-60f3-4ccb-ba9a-95c8bb33ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399073ef-8f22-47f2-a9bc-0feceb7969ab', 'volume_name': 'volume-399073ef-8f22-47f2-a9bc-0feceb7969ab', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfbc8a3-45c2-4b20-bc61-89a1ecf9b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfbc8a3-45c2-4b20-bc61-89a1ecf9b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f2d97d-e301-45cc-bcf6-e65a30c7589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Volume 399073ef-8f22-47f2-a9bc-0feceb7969ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399073ef-8f22-47f2-a9bc-0feceb7969ab', 'volume_size': 1} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:33 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 1073741824" returned: 0 in 1.107s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:33 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 Jul 08 16:34:33 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (37b604fb-162d-456b-ac2b-8bc4f130a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4769d8-132e-4ea7-9624-bf4b1a1964ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4769d8-132e-4ea7-9624-bf4b1a1964ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465362881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bdc9b6-2adb-4fa8-9fca-69cba705060c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:33Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a35f4b-2a26-4f77-b5b9-6259616acd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a35f4b-2a26-4f77-b5b9-6259616acd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687cea8a-aecd-4bd1-a371-f0142385dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687cea8a-aecd-4bd1-a371-f0142385dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67bdc9b6-2adb-4fa8-9fca-69cba705060c', 'volume_name': 'volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad39455-ac7a-414e-a946-e3925303dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad39455-ac7a-414e-a946-e3925303dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05cd6b-3ed3-41d4-bcfd-f7f0bfb780f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Volume 67bdc9b6-2adb-4fa8-9fca-69cba705060c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c', 'volume_size': 1} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (93a15a68-4098-4412-87d5-8cf49070c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda1d49-9bfd-45e8-835b-217b9078a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda1d49-9bfd-45e8-835b-217b9078a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622881222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d1209-2017-4eae-9760-47b2305665d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:34Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1372841-a32e-4bb6-8e08-14a14b9979b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1372841-a32e-4bb6-8e08-14a14b9979b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe61568-213c-40c6-95c7-c6daa8e32d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe61568-213c-40c6-95c7-c6daa8e32d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7d1209-2017-4eae-9760-47b2305665d8', 'volume_name': 'volume-0c7d1209-2017-4eae-9760-47b2305665d8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f659723-f646-4f01-890e-dea12296a2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f659723-f646-4f01-890e-dea12296a2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4fc639-8dad-4108-9973-0edea6e50ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:33 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Volume 0c7d1209-2017-4eae-9760-47b2305665d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7d1209-2017-4eae-9760-47b2305665d8', 'volume_size': 1} Jul 08 16:34:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:34 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" returned: 0 in 0.850s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120630066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4d0560-bda2-4ece-b40d-821facc42e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 8d4d0560-bda2-4ece-b40d-821facc42e70 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:34 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:34 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 1073741824 Jul 08 16:34:34 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b80dd-9c4d-4ce7-8c42-021c8ac4f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870459b5-f16a-4eab-b599-6771967949d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 (ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4): created successfully Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870459b5-f16a-4eab-b599-6771967949d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (5074984f-e1f1-4fd0-b01e-b0755b3e1150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (02d8a6d5-25a6-4273-9eaa-e5417e9c836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261e2f4f-eeb4-453e-a69b-cbb1e326ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-938f53b9-0329-405f-abfd-16368b6016a1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261e2f4f-eeb4-453e-a69b-cbb1e326ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942935090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afaca19-a33a-436c-b121-f781a67dc7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:34Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5f9b4a-b35d-46d1-abb1-8644fee3903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5f9b4a-b35d-46d1-abb1-8644fee3903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eab6bc7-548f-409f-ad80-1f42bd5c6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eab6bc7-548f-409f-ad80-1f42bd5c6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afaca19-a33a-436c-b121-f781a67dc7de', 'volume_name': 'volume-6afaca19-a33a-436c-b121-f781a67dc7de', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f43fd3-5fbe-44f2-abcf-25ab470e3509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f43fd3-5fbe-44f2-abcf-25ab470e3509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe628a20-f77d-4f5a-b0a6-4b1655dce257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Volume 6afaca19-a33a-436c-b121-f781a67dc7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afaca19-a33a-436c-b121-f781a67dc7de', 'volume_size': 1} Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:34 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 1073741824" returned: 0 in 0.918s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:35 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 Jul 08 16:34:35 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:35 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170768669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71a360d-5563-4834-bfc2-2ea53fb1f403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:32Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Creating volume b71a360d-5563-4834-bfc2-2ea53fb1f403 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:35 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8a0546-22d8-4fb1-b5e4-e76955931909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4d0560-bda2-4ece-b40d-821facc42e70', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:35 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 1073741824 Jul 08 16:34:35 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19f06ae-6479-4b19-a38e-e80c6982d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:35 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-8d4d0560-bda2-4ece-b40d-821facc42e70 (8d4d0560-bda2-4ece-b40d-821facc42e70): created successfully Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19f06ae-6479-4b19-a38e-e80c6982d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:35 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (b274eda7-7460-41fc-8596-892a71063870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1b633c14-ef43-4dbd-a668-114c79a9af16 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Flow 'volume_create_manager' (cef547b0-422d-4a8a-83f0-6a7f9416f055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15988ad8-2bdb-419e-8c2e-892925af8722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15988ad8-2bdb-419e-8c2e-892925af8722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e52fc31-771f-425c-8bb8-a75c7b3c6fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17675cb300c4a2db61c52f081a48b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:36Z,use_quota=True,user_id='d019213bc797496bbdecf99818f13042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85f1426c-4cef-4524-a552-7d72e7319d89),volume_type_id=85f1426c-4cef-4524-a552-7d72e7319d89)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c6c44-e8fb-472f-b727-525b454d854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c6c44-e8fb-472f-b727-525b454d854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4a33b9-9a1a-4248-828d-fd1262efd954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4a33b9-9a1a-4248-828d-fd1262efd954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e52fc31-771f-425c-8bb8-a75c7b3c6fc6', 'volume_name': 'volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6', 'volume_size': 1, 'image_id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b17bee8868880984f09b45fbba683883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd17675cb300c4a2db61c52f081a48b0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80899a8b2f660018661aff54e852396695ed7d6501240520bb6895ffe235c7f3947366c386ae540869e5d28056d2ddc7983573fc4c0e433018649b522df50d8b', 'id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c67868e-fefa-4050-b00e-9480bba33981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c67868e-fefa-4050-b00e-9480bba33981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f8d665-8192-44e4-a5f8-e685bcdd2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:36 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6', 'volume_size': 1, 'image_id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b17bee8868880984f09b45fbba683883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd17675cb300c4a2db61c52f081a48b0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80899a8b2f660018661aff54e852396695ed7d6501240520bb6895ffe235c7f3947366c386ae540869e5d28056d2ddc7983573fc4c0e433018649b522df50d8b', 'id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Trying to clone 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 from image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:34:36 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Image download 0.00 MB at 0.00 MB/s Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbfd41-6398-4fb9-99bc-25c6fb0d20ee]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:36 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 1073741824" returned: 0 in 0.939s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:36 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 Jul 08 16:34:36 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:36 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:34:36 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (1a17136d-6856-4292-97da-200519443858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326d5c18-41a5-40c5-8ced-0d3ee8817cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326d5c18-41a5-40c5-8ced-0d3ee8817cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814d818-c0e3-47f3-bb78-d1a73d5e0347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:37Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5386fb-3dca-4dd0-9f45-dd333210d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5386fb-3dca-4dd0-9f45-dd333210d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18775a10-9c64-4a03-89b4-8cae91a6ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18775a10-9c64-4a03-89b4-8cae91a6ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9814d818-c0e3-47f3-bb78-d1a73d5e0347', 'volume_name': 'volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f8920b-a168-4652-b63f-16af9abfe72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f8920b-a168-4652-b63f-16af9abfe72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec2ecc-7b07-4373-bea8-86329259d34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 9814d818-c0e3-47f3-bb78-d1a73d5e0347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347', 'volume_size': 1} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (83cfcecd-7753-4693-898d-36abe84dd87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d568d7-36bd-472b-a78d-24c514ecb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d568d7-36bd-472b-a78d-24c514ecb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522276520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a650eaa-a2f6-4be8-9339-782277f262b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:37Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ad71c-04cb-47a8-8170-64e9d230715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ad71c-04cb-47a8-8170-64e9d230715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9aa5e8-e07b-4f07-bc7e-fd0429f80a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9aa5e8-e07b-4f07-bc7e-fd0429f80a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a650eaa-a2f6-4be8-9339-782277f262b5', 'volume_name': 'volume-5a650eaa-a2f6-4be8-9339-782277f262b5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7559687b-f270-4cfd-9d64-da213816e26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7559687b-f270-4cfd-9d64-da213816e26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7591bd-2d38-4c4b-9b58-805469f13e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 5a650eaa-a2f6-4be8-9339-782277f262b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a650eaa-a2f6-4be8-9339-782277f262b5', 'volume_size': 1} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:37 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 0 in 0.877s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:37 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403" returned: 0 in 0.858s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.512s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989127993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399073ef-8f22-47f2-a9bc-0feceb7969ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:33Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Creating volume 399073ef-8f22-47f2-a9bc-0feceb7969ab {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d164b35-a9c8-45ea-a451-2431a889cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71a360d-5563-4834-bfc2-2ea53fb1f403', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:34:37 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:37 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab 1073741824 Jul 08 16:34:37 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15327322-7294-4657-9f86-be807dd93281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Volume volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 (b71a360d-5563-4834-bfc2-2ea53fb1f403): created successfully Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15327322-7294-4657-9f86-be807dd93281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (6d3ded86-9f69-4414-be4c-0635741e3553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a8ce52ac-29dd-4096-80ef-6ecdec31dbaa tempest-CreateVolumesFromImageTest-411558353 None] Created volume successfully. Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (b0f7881c-8d14-475f-b93f-41d46ef06d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a229a-bb84-4259-9cfc-52e068f534cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a229a-bb84-4259-9cfc-52e068f534cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592158362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bfcb6a-5385-474c-9125-e3b9f8fd1176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:38Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bebbb-d44a-4c67-a035-57692f53b03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bebbb-d44a-4c67-a035-57692f53b03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c99d87-c92b-442a-8e91-981b195afdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c99d87-c92b-442a-8e91-981b195afdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bfcb6a-5385-474c-9125-e3b9f8fd1176', 'volume_name': 'volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a82c3b-6934-473d-ac98-327b604c2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a82c3b-6934-473d-ac98-327b604c2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2ca597-76f9-456c-842c-c4f77e9c3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:37 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 99bfcb6a-5385-474c-9125-e3b9f8fd1176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176', 'volume_size': 1} Jul 08 16:34:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (d426d6a8-a25d-46cb-b345-110011080ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889a472-1518-45e3-8ca1-e9e769f54e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889a472-1518-45e3-8ca1-e9e769f54e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460629077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a060057-19b5-4636-8aae-a8a27557e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:38Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd242566-5491-444a-9ffa-a8e196f71539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd242566-5491-444a-9ffa-a8e196f71539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd210c5-8349-4150-ac2d-33d0a190d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd210c5-8349-4150-ac2d-33d0a190d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a060057-19b5-4636-8aae-a8a27557e4f4', 'volume_name': 'volume-5a060057-19b5-4636-8aae-a8a27557e4f4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c2777f-2972-43ff-a590-cb646b77188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c2777f-2972-43ff-a590-cb646b77188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afe3c46-0c18-42f8-9b3e-01db83fe34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 5a060057-19b5-4636-8aae-a8a27557e4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a060057-19b5-4636-8aae-a8a27557e4f4', 'volume_size': 1} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 1 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Temporary image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 is fetched for user d019213bc797496bbdecf99818f13042. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd072a-8581-4bf3-bbc9-af2f571e6f7a]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:38 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:34:38 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (6bb06c62-fc56-4bc9-8915-7c78cc84976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae101df-cab4-4c94-aa1d-fdc5db7dd977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae101df-cab4-4c94-aa1d-fdc5db7dd977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479944551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243bbe56-5687-41e7-9be7-b4df6728af5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:39Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90bca0e-502a-4ebc-beb5-0c24c37c82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90bca0e-502a-4ebc-beb5-0c24c37c82a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1297c653-1db3-4503-8978-6fb2f62a87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1297c653-1db3-4503-8978-6fb2f62a87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243bbe56-5687-41e7-9be7-b4df6728af5d', 'volume_name': 'volume-243bbe56-5687-41e7-9be7-b4df6728af5d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84d5fbc-ce35-4cd5-b632-16f648350861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84d5fbc-ce35-4cd5-b632-16f648350861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e71858-b0e5-417b-9e58-5a57fd23eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:38 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume 243bbe56-5687-41e7-9be7-b4df6728af5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243bbe56-5687-41e7-9be7-b4df6728af5d', 'volume_size': 1} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab 1073741824" returned: 0 in 1.084s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:38 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab Jul 08 16:34:38 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:39 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:39 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab" returned: 0 in 0.627s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.910s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465362881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bdc9b6-2adb-4fa8-9fca-69cba705060c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:33Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Creating volume 67bdc9b6-2adb-4fa8-9fca-69cba705060c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:39 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:39 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:34:39 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f2d97d-e301-45cc-bcf6-e65a30c7589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399073ef-8f22-47f2-a9bc-0feceb7969ab', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e635d3-0214-4d52-abbe-8d6bc045dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:39 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c 1073741824 Jul 08 16:34:39 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:39 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Volume volume-399073ef-8f22-47f2-a9bc-0feceb7969ab (399073ef-8f22-47f2-a9bc-0feceb7969ab): created successfully Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e635d3-0214-4d52-abbe-8d6bc045dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:39 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (813f1006-a462-452f-a5f3-e09b02345430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5712d5bd-5304-4ebb-8fab-3b9133bd057e tempest-CreateVolumesFromImageTest-411558353 None] Created volume successfully. Jul 08 16:34:40 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 1 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:40 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c 1073741824" returned: 0 in 0.822s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:40 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c Jul 08 16:34:40 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:40 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.058s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622881222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d1209-2017-4eae-9760-47b2305665d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:34Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Creating volume 0c7d1209-2017-4eae-9760-47b2305665d8 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:40 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:40 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 1073741824 Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05cd6b-3ed3-41d4-bcfd-f7f0bfb780f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:40 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c0c35-d469-41ca-96f8-58177678f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:40 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Volume volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c (67bdc9b6-2adb-4fa8-9fca-69cba705060c): created successfully Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c0c35-d469-41ca-96f8-58177678f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:40 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (37b604fb-162d-456b-ac2b-8bc4f130a838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dbb23db2-46df-44fa-a808-c3d0045391a9 tempest-CreateVolumesFromImageTest-411558353 None] Created volume successfully. Jul 08 16:34:41 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 1073741824" returned: 0 in 0.816s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:41 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 Jul 08 16:34:41 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:42 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.193s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942935090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afaca19-a33a-436c-b121-f781a67dc7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16765435fe346cd801f9a07ff6458ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:34Z,use_quota=True,user_id='5ce414e7d1744249b28108a9189b5c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Creating volume 6afaca19-a33a-436c-b121-f781a67dc7de {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:42 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4fc639-8dad-4108-9973-0edea6e50ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7d1209-2017-4eae-9760-47b2305665d8', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:42 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de 1073741824 Jul 08 16:34:42 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e235c0-962d-42df-a1cd-3485810feb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:42 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Volume volume-0c7d1209-2017-4eae-9760-47b2305665d8 (0c7d1209-2017-4eae-9760-47b2305665d8): created successfully Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e235c0-962d-42df-a1cd-3485810feb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (93a15a68-4098-4412-87d5-8cf49070c561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-703145f2-1769-4db9-b47e-9ff4f2615de2 tempest-CreateVolumesFromImageTest-411558353 None] Created volume successfully. Jul 08 16:34:43 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de 1073741824" returned: 0 in 0.796s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:43 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de Jul 08 16:34:43 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:43 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de" returned: 0 in 0.628s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.410s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating offline snapshot 1645138a-88b6-433d-b7e3-35a8ab891ea8 of volume ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe628a20-f77d-4f5a-b0a6-4b1655dce257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afaca19-a33a-436c-b121-f781a67dc7de', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6763a349-9203-4e4f-86f4-051c946e9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a93f23-0e35-4918-bb4f-179a77f8fd6e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Volume volume-6afaca19-a33a-436c-b121-f781a67dc7de (6afaca19-a33a-436c-b121-f781a67dc7de): created successfully Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6763a349-9203-4e4f-86f4-051c946e9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Flow 'volume_create_manager' (02d8a6d5-25a6-4273-9eaa-e5417e9c836a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:44 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dff8669f-f262-47b5-aeef-1e824cfb06f0 tempest-CreateVolumesFromImageTest-411558353 None] Created volume successfully. Jul 08 16:34:44 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 Jul 08 16:34:44 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:44 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" returned: 0 in 0.727s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:44 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 1G Jul 08 16:34:44 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-6afaca19-a33a-436c-b121-f781a67dc7de-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-6afaca19-a33a-436c-b121-f781a67dc7de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-quobyte-6afaca19-a33a-436c-b121-f781a67dc7de" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-6afaca19-a33a-436c-b121-f781a67dc7de" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d11ef-0ef0-4a57-a154-706c02ad0065]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:45 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de Jul 08 16:34:45 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:45 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 1G" returned: 0 in 0.821s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:45 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 Jul 08 16:34:45 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:45 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:45 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de Jul 08 16:34:45 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:46 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8" returned: 0 in 0.726s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:46 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 is being set with open permissions: ugo+rw Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:46 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 Jul 08 16:34:46 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:46 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-6afaca19-a33a-436c-b121-f781a67dc7de" returned: 0 in 0.699s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-6afaca19-a33a-436c-b121-f781a67dc7de" released by "delete_volume" :: held 1.501s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Created reservations ['f4333bef-942d-45ad-89c9-09794761c7e5', 'f08886f3-3c1e-4f18-b5d2-e55259aa446e', 'f80d20ce-d290-4f73-9b77-ae106c1b3c64', '00dfffcd-96d6-4047-b9a1-45ba58f3a220'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:46 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:46 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:46 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8" returned: 0 in 0.675s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:46 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info Jul 08 16:34:46 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-0c7d1209-2017-4eae-9760-47b2305665d8-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-0c7d1209-2017-4eae-9760-47b2305665d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-quobyte-0c7d1209-2017-4eae-9760-47b2305665d8" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-0c7d1209-2017-4eae-9760-47b2305665d8" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d097fb-0457-4a5e-9b18-52e64f060282]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:47 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Deleted volume successfully. Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-44c5ae33-eefb-40d1-badf-cc58631d418f tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-6afaca19-a33a-436c-b121-f781a67dc7de-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:47 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 Jul 08 16:34:47 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:47 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info" returned: 0 in 0.680s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:47 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info is being set with open permissions: ugo+rw Jul 08 16:34:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:47 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info Jul 08 16:34:47 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:48 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8" returned: 0 in 0.765s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:48 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8 Jul 08 16:34:48 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:48 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.info" returned: 0 in 0.712s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.447s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.212s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814d818-c0e3-47f3-bb78-d1a73d5e0347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:37Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 9814d818-c0e3-47f3-bb78-d1a73d5e0347 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:48 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:48 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 1073741824 Jul 08 16:34:48 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5dc27fa9-aedc-47b8-8625-79c2a00ad128 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Create snapshot completed successfully Jul 08 16:34:48 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0c7d1209-2017-4eae-9760-47b2305665d8" returned: 0 in 0.652s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-0c7d1209-2017-4eae-9760-47b2305665d8" released by "delete_volume" :: held 1.457s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Created reservations ['70e5f63f-9edb-4f4a-a06a-a24b0f8fe35d', '700a384d-f5c7-49e6-8999-b13cfddcf7a6', '0bf2e09f-81aa-41f5-9978-1511dac655ec', '8ec53c1f-7642-46ca-aea6-abe8e83c14f7'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:48 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:48 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:49 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 1073741824" returned: 0 in 0.905s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:49 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 Jul 08 16:34:49 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (3322130b-c4d7-49c2-a6ca-efe47b96a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd529772-94db-45d5-a099-9f70619f7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-67bdc9b6-2adb-4fa8-9fca-69cba705060c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:49 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd529772-94db-45d5-a099-9f70619f7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472955296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb686f30-1be9-444a-8c6e-0552306e7164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:49Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df04428c-3c5e-45b9-b44d-8c1532d9b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df04428c-3c5e-45b9-b44d-8c1532d9b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbd6562-d12a-4319-8e4b-9c412154e204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbd6562-d12a-4319-8e4b-9c412154e204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb686f30-1be9-444a-8c6e-0552306e7164', 'volume_name': 'volume-bb686f30-1be9-444a-8c6e-0552306e7164', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5967ef7e-c747-4e0f-80e9-956af5002468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5967ef7e-c747-4e0f-80e9-956af5002468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f942f542-7be4-4d96-aaf5-1fd39036b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume bb686f30-1be9-444a-8c6e-0552306e7164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb686f30-1be9-444a-8c6e-0552306e7164', 'volume_size': 1} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.799s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Deleted volume successfully. Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-67bdc9b6-2adb-4fa8-9fca-69cba705060c-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-5223a55b-3b3e-450f-9cc3-6ce452a52017 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-0c7d1209-2017-4eae-9760-47b2305665d8-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-quobyte-67bdc9b6-2adb-4fa8-9fca-69cba705060c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-67bdc9b6-2adb-4fa8-9fca-69cba705060c" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c0a9a4-5566-4ac1-949d-e315b9d15329]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:49 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (65ad29c9-706d-4084-b0cd-54b9ee4ffa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283a798d-6811-432e-b56c-c980f6f3fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c Jul 08 16:34:50 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283a798d-6811-432e-b56c-c980f6f3fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-302740138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101df5ae-8582-408d-899c-dc9e5c5e1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:50Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb58db6-e758-488f-ac8f-e39750dab62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb58db6-e758-488f-ac8f-e39750dab62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f6088-ede1-45b0-9c57-bce822615971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f6088-ede1-45b0-9c57-bce822615971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101df5ae-8582-408d-899c-dc9e5c5e1e87', 'volume_name': 'volume-101df5ae-8582-408d-899c-dc9e5c5e1e87', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f89b6-66d6-4b9d-9674-8d97f89ee150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f89b6-66d6-4b9d-9674-8d97f89ee150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83696c7e-2855-4c87-a891-fdbc79275e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume 101df5ae-8582-408d-899c-dc9e5c5e1e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101df5ae-8582-408d-899c-dc9e5c5e1e87', 'volume_size': 1} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:50 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347" returned: 0 in 0.966s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.823s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522276520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a650eaa-a2f6-4be8-9339-782277f262b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:37Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 5a650eaa-a2f6-4be8-9339-782277f262b5 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec2ecc-7b07-4373-bea8-86329259d34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e870b2-9dad-428b-a403-e6d55b560abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 1073741824 Jul 08 16:34:50 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 (9814d818-c0e3-47f3-bb78-d1a73d5e0347): created successfully Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e870b2-9dad-428b-a403-e6d55b560abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (1a17136d-6856-4292-97da-200519443858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (f1a5c5ad-1d3c-4eda-834b-783c751df658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468a58f5-9263-4e1e-8a87-70d9b6ce8e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468a58f5-9263-4e1e-8a87-70d9b6ce8e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040213929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f7c07a-a625-44d2-944d-08e339472a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:50Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdfb4e6-3377-4731-91cd-d3c01e5db944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdfb4e6-3377-4731-91cd-d3c01e5db944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfed59e7-a3e1-4864-b47f-a0b2bb9c59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfed59e7-a3e1-4864-b47f-a0b2bb9c59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f7c07a-a625-44d2-944d-08e339472a7d', 'volume_name': 'volume-f1f7c07a-a625-44d2-944d-08e339472a7d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6bb808-4e5c-4282-b99e-a1604f292c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6bb808-4e5c-4282-b99e-a1604f292c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7551d882-1025-4c10-a296-07f3da53f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume f1f7c07a-a625-44d2-944d-08e339472a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f7c07a-a625-44d2-944d-08e339472a7d', 'volume_size': 1} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5e456d62-c0ac-45be-a079-2cf175ae8730 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (d27a6d40-e35c-453d-9f53-568352451f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66998f9c-475e-441a-926b-b1380461cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c" returned: 0 in 1.049s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66998f9c-475e-441a-926b-b1380461cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532505898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b5b11-da5b-41ca-8f8e-759f2f213ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:51Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128bfc3c-9da2-48ad-9557-1682d9ea7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128bfc3c-9da2-48ad-9557-1682d9ea7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4578ce50-6a94-4929-b61f-ea5024fc4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4578ce50-6a94-4929-b61f-ea5024fc4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0b5b11-da5b-41ca-8f8e-759f2f213ee2', 'volume_name': 'volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bdb383-7bf1-46ab-b574-d11b69affdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bdb383-7bf1-46ab-b574-d11b69affdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c9cc63-7c31-4ba8-8830-21818e110dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:50 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume 3c0b5b11-da5b-41ca-8f8e-759f2f213ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2', 'volume_size': 1} Jul 08 16:34:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:50 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c Jul 08 16:34:50 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (4c0dfabf-f34e-4997-8d53-ba3a7a2dca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:51 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135e33f2-1ac5-4be7-9f15-b9cecb0c4429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 1073741824" returned: 0 in 1.064s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135e33f2-1ac5-4be7-9f15-b9cecb0c4429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468010229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33349a8c-89c2-4871-bae2-746ce986081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:51Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad77f034-ad91-4ef0-8c2e-63785ffa9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad77f034-ad91-4ef0-8c2e-63785ffa9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12cbcfc-c1d8-4bdc-bd4e-bedb3c6fa3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12cbcfc-c1d8-4bdc-bd4e-bedb3c6fa3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33349a8c-89c2-4871-bae2-746ce986081b', 'volume_name': 'volume-33349a8c-89c2-4871-bae2-746ce986081b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b3f8e5-c349-49cb-8a70-3ecf86a0ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b3f8e5-c349-49cb-8a70-3ecf86a0ab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdcc8a6-5d4b-4928-8e26-8216507aaac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume 33349a8c-89c2-4871-bae2-746ce986081b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33349a8c-89c2-4871-bae2-746ce986081b', 'volume_size': 1} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:51 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 Jul 08 16:34:51 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:51 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-67bdc9b6-2adb-4fa8-9fca-69cba705060c" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-67bdc9b6-2adb-4fa8-9fca-69cba705060c" released by "delete_volume" :: held 1.865s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Created reservations ['c0b4c041-d91a-4fd6-9dde-c083c45f16db', '8b83633a-07ed-4ba1-aedd-1e7aa20f8183', 'b490a355-8734-47fb-a5b3-0a51596d59aa', 'e4916e8d-8403-4121-b5aa-5bda9f7ba23f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:51 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:51 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-399073ef-8f22-47f2-a9bc-0feceb7969ab-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-399073ef-8f22-47f2-a9bc-0feceb7969ab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-quobyte-399073ef-8f22-47f2-a9bc-0feceb7969ab" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-399073ef-8f22-47f2-a9bc-0feceb7969ab" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8861076-1df2-4a84-9771-05df8ecbe603]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:52 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.212s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592158362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bfcb6a-5385-474c-9125-e3b9f8fd1176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:38Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 99bfcb6a-5385-474c-9125-e3b9f8fd1176 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:52 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:52 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab Jul 08 16:34:52 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7591bd-2d38-4c4b-9b58-805469f13e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a650eaa-a2f6-4be8-9339-782277f262b5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:52 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 1073741824 Jul 08 16:34:52 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b56c0-9093-46ea-a202-956d6dee2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:52 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-5a650eaa-a2f6-4be8-9339-782277f262b5 (5a650eaa-a2f6-4be8-9339-782277f262b5): created successfully Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b56c0-9093-46ea-a202-956d6dee2f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (83cfcecd-7753-4693-898d-36abe84dd87b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5bb9813e-c1b4-4eab-b152-1f49692b426b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:52 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.892s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Deleted volume successfully. Jul 08 16:34:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c0952ad2-9bba-40d9-814d-08e5c72cfa78 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-67bdc9b6-2adb-4fa8-9fca-69cba705060c-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:53 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab" returned: 0 in 0.979s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:53 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab Jul 08 16:34:53 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:53 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 1073741824" returned: 0 in 1.043s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:53 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 Jul 08 16:34:53 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:53 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-399073ef-8f22-47f2-a9bc-0feceb7969ab" returned: 0 in 0.646s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-399073ef-8f22-47f2-a9bc-0feceb7969ab" released by "delete_volume" :: held 1.663s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Created reservations ['608ee414-242b-4d92-921c-2b91516abe1d', 'b02f62c4-d941-4ad3-b1da-6f0fa8eb564c', 'ee776637-f478-4934-a8b2-f1477342cf5c', 'fbe1a501-281f-49de-ae11-b324ac310812'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:53 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:53 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:53 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176" returned: 0 in 0.675s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.518s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460629077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a060057-19b5-4636-8aae-a8a27557e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:38Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 5a060057-19b5-4636-8aae-a8a27557e4f4 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:53 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:53 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2ca597-76f9-456c-842c-c4f77e9c3e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:54 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 1073741824 Jul 08 16:34:54 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50876460-64aa-460f-a879-66658300bd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 (99bfcb6a-5385-474c-9125-e3b9f8fd1176): created successfully Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50876460-64aa-460f-a879-66658300bd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (b0f7881c-8d14-475f-b93f-41d46ef06d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6b3d9d58-0006-4155-9238-ee7f11245573 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-b71a360d-5563-4834-bfc2-2ea53fb1f403-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-b71a360d-5563-4834-bfc2-2ea53fb1f403-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "cinder-quobyte-b71a360d-5563-4834-bfc2-2ea53fb1f403" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-b71a360d-5563-4834-bfc2-2ea53fb1f403" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45bf80-ddfd-48ba-9087-95a1e898070f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:54 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 Jul 08 16:34:54 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:54 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.711s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Deleted volume successfully. Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-939c1d67-beb2-47e3-a0a8-d84e432ca631 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-399073ef-8f22-47f2-a9bc-0feceb7969ab-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:54 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 1073741824" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:54 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 Jul 08 16:34:54 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:55 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:55 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403 Jul 08 16:34:55 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:55 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4" returned: 0 in 0.658s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.817s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479944551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243bbe56-5687-41e7-9be7-b4df6728af5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00dbc49adae94b6780a6fc2d92e60ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:39Z,use_quota=True,user_id='054387414d08426db6219583f6a240e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Creating volume 243bbe56-5687-41e7-9be7-b4df6728af5d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:55 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:55 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d 1073741824 Jul 08 16:34:55 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afe3c46-0c18-42f8-9b3e-01db83fe34ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a060057-19b5-4636-8aae-a8a27557e4f4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b516552d-bd07-4b60-9643-dc16f6f96fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-5a060057-19b5-4636-8aae-a8a27557e4f4 (5a060057-19b5-4636-8aae-a8a27557e4f4): created successfully Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b516552d-bd07-4b60-9643-dc16f6f96fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (d426d6a8-a25d-46cb-b345-110011080ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-184d6be2-ed5f-48ea-bb32-099043da70ed tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:55 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b71a360d-5563-4834-bfc2-2ea53fb1f403" returned: 0 in 0.650s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-quobyte-b71a360d-5563-4834-bfc2-2ea53fb1f403" released by "delete_volume" :: held 1.474s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Created reservations ['f4231da2-7012-4cd3-b53b-0f4162cf283b', '02dbd224-4cfd-43df-a437-2e5446de799c', 'fc078121-3aa8-40bf-8a4b-9d2578ba3dc2', '2db94a60-3bb1-4658-bcf8-30c9251a08c8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:55 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:34:55 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:56 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d 1073741824" returned: 0 in 0.827s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:56 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d Jul 08 16:34:56 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:56 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.693s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:56 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:34:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Deleted volume successfully. Jul 08 16:34:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4b6f0ef4-a4af-4ede-a477-9f1898a33457 tempest-CreateVolumesFromImageTest-411558353 None] Lock "cinder-b71a360d-5563-4834-bfc2-2ea53fb1f403-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:34:57 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.033s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e52fc31-771f-425c-8bb8-a75c7b3c6fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17675cb300c4a2db61c52f081a48b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:36Z,use_quota=True,user_id='d019213bc797496bbdecf99818f13042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85f1426c-4cef-4524-a552-7d72e7319d89),volume_type_id=85f1426c-4cef-4524-a552-7d72e7319d89)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Creating volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:57 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:57 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1073741824 Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e71858-b0e5-417b-9e58-5a57fd23eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243bbe56-5687-41e7-9be7-b4df6728af5d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:57 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7738f2d8-7040-4bce-b56c-e77ffcd1b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:34:57 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Volume volume-243bbe56-5687-41e7-9be7-b4df6728af5d (243bbe56-5687-41e7-9be7-b4df6728af5d): created successfully Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7738f2d8-7040-4bce-b56c-e77ffcd1b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:34:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Flow 'volume_create_manager' (6bb06c62-fc56-4bc9-8915-7c78cc84976d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:34:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5b24f546-8660-49fd-8094-0a7eb4f2714f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created volume successfully. Jul 08 16:34:58 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1073741824" returned: 0 in 0.875s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:58 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:34:58 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-243bbe56-5687-41e7-9be7-b4df6728af5d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-243bbe56-5687-41e7-9be7-b4df6728af5d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-243bbe56-5687-41e7-9be7-b4df6728af5d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-243bbe56-5687-41e7-9be7-b4df6728af5d" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322bb63-4da1-4750-a576-d0603303c567]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:58 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d Jul 08 16:34:58 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:58 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 0 in 0.756s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.067s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472955296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb686f30-1be9-444a-8c6e-0552306e7164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:49Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume bb686f30-1be9-444a-8c6e-0552306e7164 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:34:58 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:58 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 1073741824 Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Attempting download of fdb0b65d-9a7f-4209-9f87-d4f4f2410124 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}])) to volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:34:58 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[858115a2-94e4-4671-ad4d-1ff44d4a2e52]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:34:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:59 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8 Jul 08 16:34:59 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:59 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d" returned: 0 in 0.820s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:59 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d Jul 08 16:34:59 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:59 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8" returned: 0 in 0.828s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:59 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 1073741824" returned: 0 in 1.018s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:34:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:34:59 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8 Jul 08 16:34:59 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:34:59 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 Jul 08 16:34:59 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:00 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-243bbe56-5687-41e7-9be7-b4df6728af5d" returned: 0 in 0.896s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-243bbe56-5687-41e7-9be7-b4df6728af5d" released by "delete_volume" :: held 1.780s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['532d1331-5cb2-4f83-9645-4d647b2f8c80', '7afe1db6-5ec9-4b84-958f-ba710c740c73', 'c999626c-5659-4d85-9613-4f3f836de19d', 'b9758b65-405f-4f15-9459-279bf5278dc1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:00 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:00 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-5a060057-19b5-4636-8aae-a8a27557e4f4-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-5a060057-19b5-4636-8aae-a8a27557e4f4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-5a060057-19b5-4636-8aae-a8a27557e4f4" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-5a060057-19b5-4636-8aae-a8a27557e4f4" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:00 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8" returned: 1 in 0.954s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_a1qu3it8' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b402dc2b-7bae-442e-a0ad-489eb559c7a6]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee803b58-e6d7-41b6-99b1-2b05e7a17787]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:00 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164" returned: 0 in 0.949s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.768s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-302740138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101df5ae-8582-408d-899c-dc9e5c5e1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:50Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume 101df5ae-8582-408d-899c-dc9e5c5e1e87 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:00 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:35:00 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:00 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:00 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 1073741824 Jul 08 16:35:00 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:00 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 Jul 08 16:35:00 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f942f542-7be4-4d96-aaf5-1fd39036b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb686f30-1be9-444a-8c6e-0552306e7164', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bec376-cb77-423e-954c-57f6a1de6603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:00 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-bb686f30-1be9-444a-8c6e-0552306e7164 (bb686f30-1be9-444a-8c6e-0552306e7164): created successfully Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bec376-cb77-423e-954c-57f6a1de6603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (3322130b-c4d7-49c2-a6ca-efe47b96a26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-32a426fa-005c-4981-ad02-40eab6ce694d tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:35:01 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.064s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-290e2af1-3ffa-4fd6-b392-afd46a906588 tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-243bbe56-5687-41e7-9be7-b4df6728af5d-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:01 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:01 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD Jul 08 16:35:01 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:01 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4" returned: 0 in 1.152s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:01 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4 Jul 08 16:35:01 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:01 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 1073741824" returned: 0 in 1.100s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:02 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 Jul 08 16:35:02 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:02 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD" returned: 1 in 0.887s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] fdb0b65d-9a7f-4209-9f87-d4f4f2410124 was raw, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:02 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:02 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Flow 'volume_create_manager' (4d31a58a-6547-43a7-8dc6-c1a3458ea5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0687068b-c5a5-469d-a2f1-823870e08ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0687068b-c5a5-469d-a2f1-823870e08ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595c043-69bc-477c-bb92-f168fa9084d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c6c299c99a417fa1bb15727589bcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:03Z,use_quota=True,user_id='ce4ae328ee604301b6d3ddeb1cc68869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8f174-3556-4b7b-8710-c4e74572f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8f174-3556-4b7b-8710-c4e74572f268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915bec16-e151-4fbd-96dc-a6d56f86e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.image.glance [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Creating Keystone auth plugin from conf {{(pid=87227) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 16:35:02 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a060057-19b5-4636-8aae-a8a27557e4f4" returned: 0 in 0.841s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-5a060057-19b5-4636-8aae-a8a27557e4f4" released by "delete_volume" :: held 2.074s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:02 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87" returned: 0 in 0.751s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.285s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040213929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f7c07a-a625-44d2-944d-08e339472a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:50Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume f1f7c07a-a625-44d2-944d-08e339472a7d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:02 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:02 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d 1073741824 Jul 08 16:35:02 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83696c7e-2855-4c87-a891-fdbc79275e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101df5ae-8582-408d-899c-dc9e5c5e1e87', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734449cb-e02b-4eed-abf3-92cdfe4496c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:02 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 (101df5ae-8582-408d-899c-dc9e5c5e1e87): created successfully Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734449cb-e02b-4eed-abf3-92cdfe4496c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (65ad29c9-706d-4084-b0cd-54b9ee4ffa5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6075ed43-834a-43b5-9310-ab2edf8c36ec tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['3a9bb26e-fb11-4451-bf72-d85afaf12b16', '5d609f54-c689-42bb-9add-ca5a10988f2b', '9deec980-3504-4e76-bbf2-61a6776ce798', 'a27bfe69-251f-4e03-83a0-6b0838214a40'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:03 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:03 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915bec16-e151-4fbd-96dc-a6d56f86e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9595c043-69bc-477c-bb92-f168fa9084d8', 'volume_name': 'volume-9595c043-69bc-477c-bb92-f168fa9084d8', 'volume_size': 1, 'image_id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9283c206b4f301604eab458851e8da98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c6c299c99a417fa1bb15727589bcfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '307663436b1013545f594cc8d2dbb08f9a4103210584fd0b1d19e475195511ef6bda3bc98ecf2c8acd4bdaf65988f22603a111f819364f2d4db357062a62a74f', 'id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'created_at': datetime.datetime(2026, 7, 8, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e06a9-2adf-4492-9700-05f0f3bc22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e06a9-2adf-4492-9700-05f0f3bc22a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5854b04-c062-4f31-b8b0-499044922cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Volume 9595c043-69bc-477c-bb92-f168fa9084d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9595c043-69bc-477c-bb92-f168fa9084d8', 'volume_size': 1, 'image_id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9283c206b4f301604eab458851e8da98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c6c299c99a417fa1bb15727589bcfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '307663436b1013545f594cc8d2dbb08f9a4103210584fd0b1d19e475195511ef6bda3bc98ecf2c8acd4bdaf65988f22603a111f819364f2d4db357062a62a74f', 'id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'created_at': datetime.datetime(2026, 7, 8, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b/file', 'properties': {}}, 'image_service': } Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Trying to clone 9595c043-69bc-477c-bb92-f168fa9084d8 from image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}]). {{(pid=87227) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 16:35:03 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Image download 0.00 MB at 0.00 MB/s Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b1fcc-476a-4300-9efd-5bb92181bd27]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:03 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 0 in 0.942s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fdb0b65d-9a7f-4209-9f87-d4f4f2410124_q8y1g838devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:35:03 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:03 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1G Jul 08 16:35:03 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:03 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:03 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:03 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.741s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ba046e02-9e57-442d-8168-d914283dc55f tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-5a060057-19b5-4636-8aae-a8a27557e4f4-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:03 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d 1073741824" returned: 0 in 1.078s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-99bfcb6a-5385-474c-9125-e3b9f8fd1176-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-99bfcb6a-5385-474c-9125-e3b9f8fd1176-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:04 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d Jul 08 16:35:04 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-99bfcb6a-5385-474c-9125-e3b9f8fd1176" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-99bfcb6a-5385-474c-9125-e3b9f8fd1176" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[034dd9cd-9e9a-468b-98f0-1a287db7f464]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:04 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 Jul 08 16:35:04 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:04 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 0 in 0.920s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:04 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 1G" returned: 0 in 0.859s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d8f38-10d6-45f5-bb07-c30ce6300497]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:04 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:04 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:04 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:04 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:04 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d" returned: 0 in 0.735s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.734s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532505898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0b5b11-da5b-41ca-8f8e-759f2f213ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:51Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume 3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:04 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7551d882-1025-4c10-a296-07f3da53f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f7c07a-a625-44d2-944d-08e339472a7d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7bb611-d7d4-4278-b7f9-865c8ab3ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:04 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 1073741824 Jul 08 16:35:04 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:04 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-f1f7c07a-a625-44d2-944d-08e339472a7d (f1f7c07a-a625-44d2-944d-08e339472a7d): created successfully Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7bb611-d7d4-4278-b7f9-865c8ab3ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (f1a5c5ad-1d3c-4eda-834b-783c751df658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8251ebb8-fd2b-4ab4-adb6-d6eebe74fb4c tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:35:04 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176" returned: 0 in 0.909s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:05 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176 Jul 08 16:35:05 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:05 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 1 in 0.813s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Temporary image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b is fetched for user ce4ae328ee604301b6d3ddeb1cc68869. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[070c620e-51d9-4bb2-bd78-01aa407067e4]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:05 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:05 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:05 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 0 in 0.959s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:05 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:05 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:05 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 1073741824" returned: 0 in 1.064s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:05 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-99bfcb6a-5385-474c-9125-e3b9f8fd1176" returned: 0 in 0.797s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-99bfcb6a-5385-474c-9125-e3b9f8fd1176" released by "delete_volume" :: held 1.772s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:05 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 Jul 08 16:35:05 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['d1a02281-81de-4479-b104-b3dbaf7d4b7f', 'aa1d385f-f24e-4381-b12a-72b71eeb91d0', 'f34b0a61-73ae-4cf9-b5b1-b6b93a27962d', 'baaf4222-002c-4817-bf96-a4926794ae29'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:06 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:06 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:06 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 0 in 0.892s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:06 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:06 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:06 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 1 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Downloaded image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}])) to volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Temporary image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 for user d019213bc797496bbdecf99818f13042 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Marking volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Copying metadata from image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 to 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Creating volume glance metadata for volume 1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 backed by image fdb0b65d-9a7f-4209-9f87-d4f4f2410124 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b17bee8868880984f09b45fbba683883', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-5a650eaa-a2f6-4be8-9339-782277f262b5-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-5a650eaa-a2f6-4be8-9339-782277f262b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f8d665-8192-44e4-a5f8-e685bcdd2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6', 'volume_size': 1, 'image_id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b17bee8868880984f09b45fbba683883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd17675cb300c4a2db61c52f081a48b0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80899a8b2f660018661aff54e852396695ed7d6501240520bb6895ffe235c7f3947366c386ae540869e5d28056d2ddc7983573fc4c0e433018649b522df50d8b', 'id': 'fdb0b65d-9a7f-4209-9f87-d4f4f2410124', 'created_at': datetime.datetime(2026, 7, 8, 14, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb0b65d-9a7f-4209-9f87-d4f4f2410124/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ec4b1-fb0d-4b23-8fc8-218ed4a47f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Volume volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 (1e52fc31-771f-425c-8bb8-a75c7b3c6fc6): created successfully Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ec4b1-fb0d-4b23-8fc8-218ed4a47f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Flow 'volume_create_manager' (cef547b0-422d-4a8a-83f0-6a7f9416f055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-5a650eaa-a2f6-4be8-9339-782277f262b5" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4b959b1b-dd73-473d-8d5c-b916f958a2f7 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Created volume successfully. Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-5a650eaa-a2f6-4be8-9339-782277f262b5" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8089ad-693e-4291-949e-37c2811817e7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:06 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 Jul 08 16:35:06 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:06 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" returned: 0 in 0.889s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:06 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.296s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468010229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33349a8c-89c2-4871-bae2-746ce986081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c877ce449684777be83c5333aa38a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:34:51Z,use_quota=True,user_id='a8901e06161f4a2f94d47a9b1c5f56ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Creating volume 33349a8c-89c2-4871-bae2-746ce986081b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:06 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b 1073741824 Jul 08 16:35:06 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c9cc63-7c31-4ba8-8830-21818e110dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8106cf19-75d2-44e4-827a-eb74950aae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 (3c0b5b11-da5b-41ca-8f8e-759f2f213ee2): created successfully Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8106cf19-75d2-44e4-827a-eb74950aae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (d27a6d40-e35c-453d-9f53-568352451f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:06 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-46b8667a-272d-4ba2-8fbb-9389c596846d tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-99bfcb6a-5385-474c-9125-e3b9f8fd1176-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:06 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-5ee30773-e149-483f-a0bd-bcc833afd675 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:35:07 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 1 in 0.968s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:07 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5" returned: 0 in 0.825s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Acquiring lock "cinder-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:07 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5 Jul 08 16:35:07 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "cinder-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Acquiring lock "cinder-quobyte-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "cinder-quobyte-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc455548-312f-41b9-87e0-5c608a2a19b8]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:07 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:07 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:07 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b 1073741824" returned: 0 in 0.936s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:07 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b Jul 08 16:35:07 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:08 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5a650eaa-a2f6-4be8-9339-782277f262b5" returned: 0 in 0.742s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-5a650eaa-a2f6-4be8-9339-782277f262b5" released by "delete_volume" :: held 1.618s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['64cd7d3c-0115-42e2-81a6-657e5b5179a9', 'b13695ad-0aa7-4258-a412-35ca31d01f39', '9a23531f-62d1-45f0-b535-7e69eb89b1cc', 'bc059d1f-7d52-4028-b12a-6ee177c8bfbf'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:08 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:08 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:08 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:08 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:08 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:08 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b" returned: 0 in 0.701s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595c043-69bc-477c-bb92-f168fa9084d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c6c299c99a417fa1bb15727589bcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:03Z,use_quota=True,user_id='ce4ae328ee604301b6d3ddeb1cc68869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Creating volume 9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:08 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdcc8a6-5d4b-4928-8e26-8216507aaac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33349a8c-89c2-4871-bae2-746ce986081b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:08 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1073741824 Jul 08 16:35:08 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996bdb7-3e22-40e0-874c-c1c7bcfdcacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Volume volume-33349a8c-89c2-4871-bae2-746ce986081b (33349a8c-89c2-4871-bae2-746ce986081b): created successfully Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996bdb7-3e22-40e0-874c-c1c7bcfdcacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Flow 'volume_create_manager' (4c0dfabf-f34e-4997-8d53-ba3a7a2dca5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e42bfcef-a229-4043-acf6-86caf1d46b1e tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created volume successfully. Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-9814d818-c0e3-47f3-bb78-d1a73d5e0347-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-9814d818-c0e3-47f3-bb78-d1a73d5e0347-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-9814d818-c0e3-47f3-bb78-d1a73d5e0347" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-9814d818-c0e3-47f3-bb78-d1a73d5e0347" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81cef02-f69b-484a-93a1-f60b069d65cd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:08 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 Jul 08 16:35:08 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-33349a8c-89c2-4871-bae2-746ce986081b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-33349a8c-89c2-4871-bae2-746ce986081b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:09 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-33349a8c-89c2-4871-bae2-746ce986081b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fde6640a-2907-4471-a78a-54af1c373ded tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-5a650eaa-a2f6-4be8-9339-782277f262b5-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-33349a8c-89c2-4871-bae2-746ce986081b" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b670c5b-f072-4548-bd7b-b2fc5aaaa56c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:09 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 1 in 0.978s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:09 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6 Jul 08 16:35:09 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:09 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b Jul 08 16:35:09 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:09 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1073741824" returned: 0 in 0.979s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:09 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:09 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:09 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347" returned: 0 in 0.945s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:09 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347 Jul 08 16:35:09 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:09 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" returned: 0 in 0.728s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "cinder-quobyte-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6" released by "delete_volume" :: held 2.613s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Created reservations ['fa0ffd89-c7b6-4df8-9641-f326d53e2d3a', 'bba3292c-2fb6-4429-a6f8-3ae9153aab77', '33863381-2b9c-4d37-8092-5f59b1e9d23d', 'f6e4b20d-d19f-4b24-922e-168fc8db04c1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:10 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b" returned: 0 in 0.874s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:10 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b Jul 08 16:35:10 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:10 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:10 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:10 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 0 in 0.859s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Attempting download of 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b ((None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}])) to volume 9595c043-69bc-477c-bb92-f168fa9084d8. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4411f7-e0ff-4ce7-af78-448eab632acd]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:10 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9814d818-c0e3-47f3-bb78-d1a73d5e0347" returned: 0 in 0.780s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-9814d818-c0e3-47f3-bb78-d1a73d5e0347" released by "delete_volume" :: held 1.780s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['5308ff4b-40dd-4307-a775-f649e901d561', '24de894f-ffbc-4eb0-b18b-2e8f3570e95f', 'b31f7c40-8faa-40d6-b1d3-0f30c761ee77', '8307d765-83df-4d08-bcfd-de21f8429612'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:10 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8 Jul 08 16:35:10 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:10 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:10 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:10 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-33349a8c-89c2-4871-bae2-746ce986081b" returned: 0 in 0.881s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-33349a8c-89c2-4871-bae2-746ce986081b" released by "delete_volume" :: held 1.817s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-8d4d0560-bda2-4ece-b40d-821facc42e70-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:11 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-8d4d0560-bda2-4ece-b40d-821facc42e70-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.954s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Deleted volume successfully. Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3165b7d0-8f03-42ea-b618-a6ec66ff3eb2 tempest-VolumeAndVolumeTypeFromImageTest-87992369 None] Lock "cinder-1e52fc31-771f-425c-8bb8-a75c7b3c6fc6-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['b43e7fb3-b1d8-4e42-9feb-f0c80f4eacde', '46297f29-4315-44e9-bca4-78b3236d3452', 'aecefc6c-0a7b-4cd4-9aa0-241ad5f60054', '7b8601fc-ca73-43ea-acb4-347651bdebe0'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "cinder-quobyte-8d4d0560-bda2-4ece-b40d-821facc42e70" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-8d4d0560-bda2-4ece-b40d-821facc42e70" acquired by "delete_volume" :: waited 0.038s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646581e-e166-457c-a2e3-bf67a4aee81e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:11 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:11 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:11 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 Jul 08 16:35:11 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" acquired by "delete_volume" :: waited 0.035s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:11 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8" returned: 0 in 1.239s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f94ed8-9f34-42f4-a03e-794b2d775851]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:11 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8 Jul 08 16:35:11 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:11 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.325s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:11 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:12 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 Jul 08 16:35:12 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ac52b537-3e29-47ed-8e54-47a79c7f705c tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-9814d818-c0e3-47f3-bb78-d1a73d5e0347-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:12 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70" returned: 0 in 1.041s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:12 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70 Jul 08 16:35:12 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:12 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.115s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-694d6ace-ab0d-4fa2-9377-00847f1ab014 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-33349a8c-89c2-4871-bae2-746ce986081b-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:12 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8" returned: 1 in 1.126s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_d4mdiac8' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f247dc5c-9643-45ed-a0ab-5af9dd89a031]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:12 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" returned: 0 in 1.164s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:12 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2 Jul 08 16:35:12 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:12 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:12 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:13 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-8d4d0560-bda2-4ece-b40d-821facc42e70" returned: 0 in 0.891s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-quobyte-8d4d0560-bda2-4ece-b40d-821facc42e70" released by "delete_volume" :: held 2.004s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Created reservations ['cf675f8a-e6ef-4e7e-a1b8-fa7f8bce45fb', 'fa7a1419-19f9-4a84-9cc1-fc97c2bbff01', '466b7eb9-fcfc-4a31-8078-6e685cee143f', 'b587adbc-26f4-4374-8473-cf92c95f3fb8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:13 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:13 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:13 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" returned: 0 in 0.900s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:13 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 0 in 0.977s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2" released by "delete_volume" :: held 2.169s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:13 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['7d8af464-7e6f-484e-bbfc-32569c606c7b', '72cedfb3-a3c4-4837-835e-bc21a59611da', 'cbb853dc-1650-4c55-8f93-4b0f57f9de10', '3f6132e5-1904-44a4-9a7d-94c6f2fb5811'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:13 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD Jul 08 16:35:13 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:14 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:14 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:14 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.766s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Deleted volume successfully. Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6fe05821-d502-4da8-8d6f-d7497401d79b tempest-CreateVolumesFromSourceVolumeTest-1767314389 None] Lock "cinder-8d4d0560-bda2-4ece-b40d-821facc42e70-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:14 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD" returned: 1 in 0.897s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b was raw, converting to raw {{(pid=87227) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:14 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:14 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:14 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b42e1278-e47b-49ae-be39-8723f11b313a tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-3c0b5b11-da5b-41ca-8f8e-759f2f213ee2-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-f1f7c07a-a625-44d2-944d-08e339472a7d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-f1f7c07a-a625-44d2-944d-08e339472a7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-f1f7c07a-a625-44d2-944d-08e339472a7d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-f1f7c07a-a625-44d2-944d-08e339472a7d" acquired by "delete_volume" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c83dd2-15d5-4101-bd01-526076ccf7c3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:15 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d Jul 08 16:35:15 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:15 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 0 in 0.987s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b_9z__eb10devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:35:15 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 16:35:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:15 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1G Jul 08 16:35:15 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:16 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d" returned: 0 in 1.123s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:16 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d Jul 08 16:35:16 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:16 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 1G" returned: 0 in 0.886s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a444357-e333-41e6-a4af-19df77a89f33]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:16 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:16 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Flow 'volume_create_manager' (d9045864-1169-4b33-836d-de7a45bba502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56791b4c-61b8-4f30-8a40-90d89d9bca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56791b4c-61b8-4f30-8a40-90d89d9bca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bee1a74-f470-4e03-bd5f-a11d22a83d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353f7a487324bfebff82b38173fd960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:17Z,use_quota=True,user_id='88d9870e33674543bd1e1d0c99f5f677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aea89b-3ef4-4aaa-aa10-7969d369f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aea89b-3ef4-4aaa-aa10-7969d369f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb97fe63-d9d1-42d8-9dd6-b26b73f9e4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb97fe63-d9d1-42d8-9dd6-b26b73f9e4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bee1a74-f470-4e03-bd5f-a11d22a83d1c', 'volume_name': 'volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7585f98e-8962-4c34-908f-4e8d5a723211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7585f98e-8962-4c34-908f-4e8d5a723211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62526b8b-1036-45b7-a428-fccbd18ae235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:17 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Volume 5bee1a74-f470-4e03-bd5f-a11d22a83d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c', 'volume_size': 1} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bee1a74-f470-4e03-bd5f-a11d22a83d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353f7a487324bfebff82b38173fd960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:17Z,use_quota=True,user_id='88d9870e33674543bd1e1d0c99f5f677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Creating volume 5bee1a74-f470-4e03-bd5f-a11d22a83d1c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:17 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:17 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c 1073741824 Jul 08 16:35:17 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:17 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-f1f7c07a-a625-44d2-944d-08e339472a7d" returned: 0 in 0.908s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-f1f7c07a-a625-44d2-944d-08e339472a7d" released by "delete_volume" :: held 2.093s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['f878ddc3-f558-47a6-aa4b-06999cc2837f', '1dde04c0-d252-42f2-bef3-b2db1acf763d', '83b83d1f-a42b-4305-915f-a4c8d0f12fee', 'df268154-62e0-471d-b189-1dd571b6e598'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:17 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:17 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:17 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 0 in 0.954s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:17 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:17 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:18 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a8223e1-acb8-4a4c-8b50-6f3cba6d221b tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-f1f7c07a-a625-44d2-944d-08e339472a7d-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:18 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c 1073741824" returned: 0 in 1.118s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:18 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c Jul 08 16:35:18 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Flow 'volume_create_manager' (c6283e5a-62e5-435e-a91f-80741dfe41fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39aabb-d025-4819-8846-5e6c54e819d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-101df5ae-8582-408d-899c-dc9e5c5e1e87-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39aabb-d025-4819-8846-5e6c54e819d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1310658637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2791260-bc2d-44d2-9156-fbfd5f40f654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a918938fbbf4530bed4a50f80d2fe60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:18Z,use_quota=True,user_id='ce272875ce384b5f98826674a5dc3e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fb2f5d-2f0b-4268-a16a-273abceaa901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fb2f5d-2f0b-4268-a16a-273abceaa901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24623e85-d657-452b-83c1-740b92669bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24623e85-d657-452b-83c1-740b92669bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2791260-bc2d-44d2-9156-fbfd5f40f654', 'volume_name': 'volume-b2791260-bc2d-44d2-9156-fbfd5f40f654', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fa2bdb-85af-4196-8b57-6886aed15cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fa2bdb-85af-4196-8b57-6886aed15cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1109797-5fa2-48cb-aa12-e4df51811cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Volume b2791260-bc2d-44d2-9156-fbfd5f40f654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2791260-bc2d-44d2-9156-fbfd5f40f654', 'volume_size': 1} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-101df5ae-8582-408d-899c-dc9e5c5e1e87-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-101df5ae-8582-408d-899c-dc9e5c5e1e87" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:18 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 1 in 0.909s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Downloaded image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b ((None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}])) to volume 9595c043-69bc-477c-bb92-f168fa9084d8 successfully. {{(pid=87227) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Temporary image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b for user ce4ae328ee604301b6d3ddeb1cc68869 is deleted. {{(pid=87227) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.volume_utils [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Marking volume 9595c043-69bc-477c-bb92-f168fa9084d8 as bootable. {{(pid=87227) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-101df5ae-8582-408d-899c-dc9e5c5e1e87" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Copying metadata from image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b to 9595c043-69bc-477c-bb92-f168fa9084d8. {{(pid=87227) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Creating volume glance metadata for volume 9595c043-69bc-477c-bb92-f168fa9084d8 backed by image 1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b with: {'image_id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9283c206b4f301604eab458851e8da98', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87227) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba39666-bfb8-4042-af68-6da58b8d2bd8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5854b04-c062-4f31-b8b0-499044922cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9595c043-69bc-477c-bb92-f168fa9084d8', 'volume_size': 1, 'image_id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9283c206b4f301604eab458851e8da98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c6c299c99a417fa1bb15727589bcfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '307663436b1013545f594cc8d2dbb08f9a4103210584fd0b1d19e475195511ef6bda3bc98ecf2c8acd4bdaf65988f22603a111f819364f2d4db357062a62a74f', 'id': '1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b', 'created_at': datetime.datetime(2026, 7, 8, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f87f2e0-1c49-47c2-b19f-cdd5414aaa6b/file', 'properties': {}}, 'image_service': }' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79ab35d-e838-428f-a739-3ab01259d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:18 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Volume volume-9595c043-69bc-477c-bb92-f168fa9084d8 (9595c043-69bc-477c-bb92-f168fa9084d8): created successfully Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79ab35d-e838-428f-a739-3ab01259d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Flow 'volume_create_manager' (4d31a58a-6547-43a7-8dc6-c1a3458ea5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a7048b39-7fbe-408c-9a67-3e871684e1ee tempest-VolumeImageDependencyTests-1102808669 None] Created volume successfully. Jul 08 16:35:18 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 Jul 08 16:35:18 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:18 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1310658637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2791260-bc2d-44d2-9156-fbfd5f40f654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a918938fbbf4530bed4a50f80d2fe60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:18Z,use_quota=True,user_id='ce272875ce384b5f98826674a5dc3e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Creating volume b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:18 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62526b8b-1036-45b7-a428-fccbd18ae235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:18 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 1073741824 Jul 08 16:35:18 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8b56d5-038b-44f4-9555-95a140ac35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:19 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Volume volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c (5bee1a74-f470-4e03-bd5f-a11d22a83d1c): created successfully Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8b56d5-038b-44f4-9555-95a140ac35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Flow 'volume_create_manager' (d9045864-1169-4b33-836d-de7a45bba502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:19 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-648f1601-772d-4b93-bfe6-eb0b7dfb5014 tempest-CinderUnicodeTest-1216565470 None] Created volume successfully. Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Acquiring lock "cinder-9595c043-69bc-477c-bb92-f168fa9084d8-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "cinder-9595c043-69bc-477c-bb92-f168fa9084d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Acquiring lock "cinder-quobyte-9595c043-69bc-477c-bb92-f168fa9084d8" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "cinder-quobyte-9595c043-69bc-477c-bb92-f168fa9084d8" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a082bb-4b47-4e2e-843e-30b955228174]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:19 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:19 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:19 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87" returned: 0 in 0.851s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:19 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:19 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:19 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87 Jul 08 16:35:19 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:19 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 1073741824" returned: 0 in 0.901s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:19 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:19 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:20 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:20 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 0 in 0.935s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-101df5ae-8582-408d-899c-dc9e5c5e1e87" returned: 0 in 0.765s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:20 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.813s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-101df5ae-8582-408d-899c-dc9e5c5e1e87" released by "delete_volume" :: held 1.689s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['4b75d5b7-a35e-4c6e-9315-8141a2abca92', 'e9281b7f-20da-4d91-b9a3-39917e83358f', '2c1a50c2-6f91-4bb6-a774-66668b941568', 'ed78c156-08bc-4346-a369-7542ec4654fa'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:20 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:20 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:20 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:20 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-bb686f30-1be9-444a-8c6e-0552306e7164-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-bb686f30-1be9-444a-8c6e-0552306e7164-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-bb686f30-1be9-444a-8c6e-0552306e7164" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:20 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Flow 'volume_create_manager' (2276922d-bd37-464e-b123-bd51287b1044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be37172-4259-47d2-95f9-3be11357fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-bb686f30-1be9-444a-8c6e-0552306e7164" acquired by "delete_volume" :: waited 0.078s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 1.054s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66ff4e2-425b-4493-a39c-43e56959d7ea]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be37172-4259-47d2-95f9-3be11357fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-712079530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b80874-86c4-4102-bb52-f1f9348d243c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353f7a487324bfebff82b38173fd960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:21Z,use_quota=True,user_id='88d9870e33674543bd1e1d0c99f5f677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2658ffe-c7aa-423e-8718-3f231a44d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2658ffe-c7aa-423e-8718-3f231a44d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85460dd-f55b-4f81-ad9b-a4d8d54acfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85460dd-f55b-4f81-ad9b-a4d8d54acfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b80874-86c4-4102-bb52-f1f9348d243c', 'volume_name': 'volume-66b80874-86c4-4102-bb52-f1f9348d243c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ee9593-2fa2-4f0c-a751-ff94471b3b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ee9593-2fa2-4f0c-a751-ff94471b3b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd4d003-e7c2-4193-acec-24fdd0508c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:21 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Volume 66b80874-86c4-4102-bb52-f1f9348d243c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b80874-86c4-4102-bb52-f1f9348d243c', 'volume_size': 1} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-712079530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b80874-86c4-4102-bb52-f1f9348d243c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353f7a487324bfebff82b38173fd960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:21Z,use_quota=True,user_id='88d9870e33674543bd1e1d0c99f5f677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Creating volume 66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:21 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1109797-5fa2-48cb-aa12-e4df51811cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2791260-bc2d-44d2-9156-fbfd5f40f654', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f48004-9737-4a00-a2d9-d8ffe2b48799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:21 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c 1073741824 Jul 08 16:35:21 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:21 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Volume volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 (b2791260-bc2d-44d2-9156-fbfd5f40f654): created successfully Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f48004-9737-4a00-a2d9-d8ffe2b48799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:21 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 Jul 08 16:35:21 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Flow 'volume_create_manager' (c6283e5a-62e5-435e-a91f-80741dfe41fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-92b26757-cc54-4d05-99d3-eecd1368de25 tempest-VolumeDependencyTests-973030680 None] Created volume successfully. Jul 08 16:35:21 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 1 in 0.993s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8' failed. Not Retrying. {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:21 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8 Jul 08 16:35:21 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:21 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.836s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ebc91299-d34d-46e6-974f-e7553f6c48aa tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-101df5ae-8582-408d-899c-dc9e5c5e1e87-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:21 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164" returned: 0 in 0.981s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:21 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9595c043-69bc-477c-bb92-f168fa9084d8" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "cinder-quobyte-9595c043-69bc-477c-bb92-f168fa9084d8" released by "delete_volume" :: held 2.777s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:21 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164 Jul 08 16:35:21 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Created reservations ['b9fbcae0-d64c-4c03-ac8b-81d0755eba03', 'c42af31f-329e-452a-83fd-59259eb4b585', 'f30feb94-d409-434d-be40-869837c41a46', 'b695034d-4cf7-4990-88d6-d465157f2c5e'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:22 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c 1073741824" returned: 0 in 1.073s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:22 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:22 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:22 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c Jul 08 16:35:22 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:22 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-bb686f30-1be9-444a-8c6e-0552306e7164" returned: 0 in 0.719s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-bb686f30-1be9-444a-8c6e-0552306e7164" released by "delete_volume" :: held 1.749s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['d464afc0-7ec0-4fba-9ad0-d0c541213419', '181b39fc-123d-4a1c-9d07-056c2628b27f', 'f380de74-8cbf-4abc-ba63-c04dbc440d9d', 'c7f6ad20-25d1-46d2-8fc3-d61e1ad54a64'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:22 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.744s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Deleted volume successfully. Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1618b5ed-45eb-4981-ba7a-bebd4872707a tempest-VolumeImageDependencyTests-1102808669 None] Lock "cinder-9595c043-69bc-477c-bb92-f168fa9084d8-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:22 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c" returned: 0 in 0.768s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:22 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:22 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.129s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd4d003-e7c2-4193-acec-24fdd0508c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b80874-86c4-4102-bb52-f1f9348d243c', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eec9dc2-b73e-427c-818d-f1ac19ec36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Creating offline snapshot d19016d9-5af7-4221-a6d7-4d44afbb18a3 of volume b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:35:22 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Volume volume-66b80874-86c4-4102-bb52-f1f9348d243c (66b80874-86c4-4102-bb52-f1f9348d243c): created successfully Jul 08 16:35:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eec9dc2-b73e-427c-818d-f1ac19ec36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Flow 'volume_create_manager' (2276922d-bd37-464e-b123-bd51287b1044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb7734-1d82-496e-a17a-9d0542c72bc7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-1645138a-88b6-433d-b7e3-35a8ab891ea8-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-095754e1-34bb-4257-b4f1-53ff5a759920 tempest-CinderUnicodeTest-1216565470 None] Created volume successfully. Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-1645138a-88b6-433d-b7e3-35a8ab891ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-1645138a-88b6-433d-b7e3-35a8ab891ea8" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-1645138a-88b6-433d-b7e3-35a8ab891ea8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleting offline snapshot 1645138a-88b6-433d-b7e3-35a8ab891ea8 of volume ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] snapshot_file for this snap is: volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:35:23 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:23 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f3d2a5-0077-4d1e-a068-e0ed29963b9f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:23 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 Jul 08 16:35:23 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:23 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.778s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-dbb1fbd9-fad7-481a-82e5-b256ca29c8e3 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-bb686f30-1be9-444a-8c6e-0552306e7164-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:23 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 0.938s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:23 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 1G Jul 08 16:35:23 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:24 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8" returned: 0 in 0.959s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575250c-3c34-4239-9f93-d26a04b0101d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:24 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 Jul 08 16:35:24 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:24 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 1G" returned: 0 in 0.984s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:24 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:24 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:25 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" returned: 0 in 0.874s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:25 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 Jul 08 16:35:25 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:25 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 0.739s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:25 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 is being set with open permissions: ugo+rw Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:25 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:25 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:25 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8" returned: 0 in 0.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:25 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8 Jul 08 16:35:25 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:26 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:26 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info Jul 08 16:35:26 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:26 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4.1645138a-88b6-433d-b7e3-35a8ab891ea8" returned: 0 in 0.712s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-1645138a-88b6-433d-b7e3-35a8ab891ea8" released by "_delete_snapshot" :: held 3.515s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" released by "delete_snapshot" :: held 3.549s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['31a17f26-9bd8-48c0-a454-d5e1a3ea5bb5', 'a0705e0b-f3c2-40bc-aa4b-a0f88fc04264', '8d7ca6e3-82c6-436d-9c90-82127862af90', 'f16df4be-2357-4137-9e9d-7806357cd61b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:26 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Delete snapshot completed successfully. Jul 08 16:35:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-62e42db8-74e7-4623-9369-e1a49d1c5ea1 tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-1645138a-88b6-433d-b7e3-35a8ab891ea8-delete_snapshot" released by "delete_snapshot" :: held 3.702s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:27 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info" returned: 0 in 0.658s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:27 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info is being set with open permissions: ugo+rw Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:27 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info Jul 08 16:35:27 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e295c-e199-40e8-80bc-125c283bbdb0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:27 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 Jul 08 16:35:27 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:27 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.info" returned: 0 in 0.721s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.468s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Creating offline snapshot d1b0fae8-7615-47ea-ae26-e339f75fe8c7 of volume 66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:35:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d2ca5161-fc52-4036-8cd1-2165fc8c7f61 tempest-VolumeDependencyTests-973030680 None] Create snapshot completed successfully Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d0c9fc-fe77-459a-8ec1-9c9800a7cf41]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:27 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c Jul 08 16:35:27 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:28 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" returned: 0 in 0.896s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:28 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4 Jul 08 16:35:28 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Flow 'volume_create_manager' (cc60b166-384c-464c-a089-428a15b4daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413d812e-4ac7-4ac5-b082-6204d982f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413d812e-4ac7-4ac5-b082-6204d982f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-442958327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169bd65e-cfc9-4ded-8675-7fce374130dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a918938fbbf4530bed4a50f80d2fe60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d19016d9-5af7-4221-a6d7-4d44afbb18a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:29Z,use_quota=True,user_id='ce272875ce384b5f98826674a5dc3e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffe411a-fa0c-472d-89d7-1383412e3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffe411a-fa0c-472d-89d7-1383412e3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373e59ef-e004-4d40-916d-900a435ccc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373e59ef-e004-4d40-916d-900a435ccc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '169bd65e-cfc9-4ded-8675-7fce374130dd', 'volume_name': 'volume-169bd65e-cfc9-4ded-8675-7fce374130dd', 'volume_size': 1, 'snapshot_id': 'd19016d9-5af7-4221-a6d7-4d44afbb18a3'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7a4735-45b4-44af-8c29-45a0a54cad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:28 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7a4735-45b4-44af-8c29-45a0a54cad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dd139d-ca88-48fc-97a3-297495469935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:28 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Volume 169bd65e-cfc9-4ded-8675-7fce374130dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-169bd65e-cfc9-4ded-8675-7fce374130dd', 'volume_size': 1, 'snapshot_id': 'd19016d9-5af7-4221-a6d7-4d44afbb18a3'} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c" returned: 0 in 1.005s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:28 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 1G Jul 08 16:35:28 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:29 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-quobyte-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4" released by "delete_volume" :: held 1.755s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=170,cinder:UPDATE=199,cinder:INSERT=71,cinder:DELETE=23 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Created reservations ['324283f9-ae32-4d5b-a855-406af8ff72d4', 'c379a34d-887c-4d78-9597-219f43bfe6b2', '8994acc8-19bb-430a-bf0a-30d0240206ed', '6ca487fb-8d0f-4f33-85c2-e5e9ff03bcd1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:29 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:29 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:29 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 1G" returned: 0 in 0.955s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b80874-86c4-4102-bb52-f1f9348d243c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:29 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b80874-86c4-4102-bb52-f1f9348d243c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 Jul 08 16:35:29 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:30 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.734s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Deleted volume successfully. Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=256,cinder:SELECT=159,cinder:INSERT=49,cinder:DELETE=20 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9cf18428-fffd-48a0-9163-dd418a47b15f tempest-CreateVolumesFromSnapshotTest-1544854439 None] Lock "cinder-ae8fb82f-d7e7-487b-9dad-0e3f6b55d5f4-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:30 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b80874-86c4-4102-bb52-f1f9348d243c -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:30 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 is being set with open permissions: ugo+rw Jul 08 16:35:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:30 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 Jul 08 16:35:30 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:31 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:31 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info Jul 08 16:35:31 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:32 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:32 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info is being set with open permissions: ugo+rw Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:32 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info Jul 08 16:35:32 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:32 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.info" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.146s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.068s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3-169bd65e-cfc9-4ded-8675-7fce374130dd" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3-169bd65e-cfc9-4ded-8675-7fce374130dd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Creating volume 169bd65e-cfc9-4ded-8675-7fce374130dd from snapshot d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:33 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0547cc0e-4693-4d2d-b125-d2ecc96d0133 tempest-CinderUnicodeTest-1216565470 None] Create snapshot completed successfully Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] snapshot: d19016d9-5af7-4221-a6d7-4d44afbb18a3, volume: 169bd65e-cfc9-4ded-8675-7fce374130dd, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab37c5-1192-4d91-85f2-5b3c048c0b3d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:33 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:33 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-d1b0fae8-7615-47ea-ae26-e339f75fe8c7-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-d1b0fae8-7615-47ea-ae26-e339f75fe8c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-quobyte-d1b0fae8-7615-47ea-ae26-e339f75fe8c7" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-d1b0fae8-7615-47ea-ae26-e339f75fe8c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Deleting offline snapshot d1b0fae8-7615-47ea-ae26-e339f75fe8c7 of volume 66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:35:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] snapshot_file for this snap is: volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:35:34 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27cdd0f-5605-45a3-9a60-689c39ce1b4a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 0.923s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2791260-bc2d-44d2-9156-fbfd5f40f654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[08963885-f15c-4628-bde2-8162605ac0df]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:34 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 Jul 08 16:35:34 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:34 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:34 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:34 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b80874-86c4-4102-bb52-f1f9348d243c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81166ea-b650-464c-9623-3f5b239f44fd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:34 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 0.829s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:35:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:34 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd Jul 08 16:35:34 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:34 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c Jul 08 16:35:34 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:35 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c" returned: 0 in 0.962s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:35 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 Jul 08 16:35:35 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:37 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7" returned: 0 in 1.747s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:37 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7 Jul 08 16:35:37 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:39 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c.d1b0fae8-7615-47ea-ae26-e339f75fe8c7" returned: 0 in 1.592s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-d1b0fae8-7615-47ea-ae26-e339f75fe8c7" released by "_delete_snapshot" :: held 5.388s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" released by "delete_snapshot" :: held 5.426s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:39 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Created reservations ['49568e1b-4a54-4f43-8e45-3c9cafa171ca', '3734aad0-a7e8-4b1d-b24e-a0571d9fd368', 'f3db37da-1da5-4ea6-a28f-ebd86159a9b9', '2d74ef37-dcdb-4129-8332-8875b2188434'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Delete snapshot completed successfully. Jul 08 16:35:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4715a5c9-269d-47a5-9d70-f6b80a2ed3ed tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-d1b0fae8-7615-47ea-ae26-e339f75fe8c7-delete_snapshot" released by "delete_snapshot" :: held 5.720s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-66b80874-86c4-4102-bb52-f1f9348d243c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-66b80874-86c4-4102-bb52-f1f9348d243c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572672e-c832-4a86-99c9-b928e9bfe558]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:41 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c Jul 08 16:35:41 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:41 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd" returned: 0 in 6.354s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ebb8a9-6cc0-4208-8991-24aa1a9130d5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:41 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:41 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:41 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c" returned: 0 in 1.137s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:41 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c Jul 08 16:35:41 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:42 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 1.191s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:35:42 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Converted 1024.00 MB image at 161.08 MB/s Jul 08 16:35:42 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd is being set with open permissions: ugo+rw Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:42 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd Jul 08 16:35:42 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:42 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-66b80874-86c4-4102-bb52-f1f9348d243c" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-66b80874-86c4-4102-bb52-f1f9348d243c" released by "delete_volume" :: held 2.081s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Created reservations ['d690522c-0c7e-445f-887d-1608a93b87f6', '79441f1e-aeeb-4853-ae30-9e621e1fd0d6', 'c97de2b8-03e5-43de-93d7-08a4f8eb2b41', '2db2f45e-ea3a-4485-935e-0af7b666780c'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:42 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:42 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-5bee1a74-f470-4e03-bd5f-a11d22a83d1c-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-5bee1a74-f470-4e03-bd5f-a11d22a83d1c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "cinder-quobyte-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8240a39-558c-418a-9a90-3ab12cf40fa9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:43 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd" returned: 0 in 0.883s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" released by "_copy_volume_from_snapshot" :: held 10.321s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3-169bd65e-cfc9-4ded-8675-7fce374130dd" released by "_create_volume_from_snapshot" :: held 10.363s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.400s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:43 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c Jul 08 16:35:43 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dd139d-ca88-48fc-97a3-297495469935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169bd65e-cfc9-4ded-8675-7fce374130dd', 'volume_size': 1, 'snapshot_id': 'd19016d9-5af7-4221-a6d7-4d44afbb18a3'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50474984-5929-4db3-b05e-3a097e795e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Volume volume-169bd65e-cfc9-4ded-8675-7fce374130dd (169bd65e-cfc9-4ded-8675-7fce374130dd): created successfully Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50474984-5929-4db3-b05e-3a097e795e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Flow 'volume_create_manager' (cc60b166-384c-464c-a089-428a15b4daa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ef9c76ce-89a5-47e6-85a0-ae8513def9a2 tempest-VolumeDependencyTests-973030680 None] Created volume successfully. Jul 08 16:35:43 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.905s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Deleted volume successfully. Jul 08 16:35:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f56064e7-e48c-4f4f-b72c-3c3cb2247712 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-66b80874-86c4-4102-bb52-f1f9348d243c-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-d19016d9-5af7-4221-a6d7-4d44afbb18a3-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-d19016d9-5af7-4221-a6d7-4d44afbb18a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:44 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" returned: 0 in 0.920s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:44 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c Jul 08 16:35:44 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Deleting offline snapshot d19016d9-5af7-4221-a6d7-4d44afbb18a3 of volume b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] snapshot_file for this snap is: volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0cceb-cc84-413d-9b8f-f8aecd9a1fac]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:44 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:44 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:44 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (3b6e586a-c715-476f-bd8d-31e4ff3f5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6a2683-8c7c-44e3-beaa-a28eee580c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6a2683-8c7c-44e3-beaa-a28eee580c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794345530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f93ddf-5534-46d9-b183-cfb35f06ebde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:45Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9d1bfe-58b4-4662-99fc-a208d74dfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9d1bfe-58b4-4662-99fc-a208d74dfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c51671-6d4c-4b4b-819d-3bc58713a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c51671-6d4c-4b4b-819d-3bc58713a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f93ddf-5534-46d9-b183-cfb35f06ebde', 'volume_name': 'volume-30f93ddf-5534-46d9-b183-cfb35f06ebde', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7627b7d3-12dd-4180-a690-e7f3095565a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7627b7d3-12dd-4180-a690-e7f3095565a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:45 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c6757a-e781-432c-846e-7e23823dde05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Volume 30f93ddf-5534-46d9-b183-cfb35f06ebde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f93ddf-5534-46d9-b183-cfb35f06ebde', 'volume_size': 1} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794345530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f93ddf-5534-46d9-b183-cfb35f06ebde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:45Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Creating volume 30f93ddf-5534-46d9-b183-cfb35f06ebde {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:45 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" returned: 0 in 0.891s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:45 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde 1073741824 Jul 08 16:35:45 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-quobyte-5bee1a74-f470-4e03-bd5f-a11d22a83d1c" released by "delete_volume" :: held 1.896s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Created reservations ['e1064a56-9692-424c-8d22-a365fca271da', 'e03f87e9-a843-4eae-a4dd-c098ca3476fd', '359c36b9-6379-4e93-a475-26a99907a68f', 'ca8b0425-42ea-47d5-bc69-1916775c712a'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:45 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 0.981s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2791260-bc2d-44d2-9156-fbfd5f40f654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb1e28-4dcf-41af-8786-b6e51fba4c55]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:45 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:45 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:45 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:45 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:46 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.837s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Deleted volume successfully. Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2c06453d-4eaf-4882-af5a-c1713aa0d1d4 tempest-CinderUnicodeTest-1216565470 None] Lock "cinder-5bee1a74-f470-4e03-bd5f-a11d22a83d1c-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:46 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde 1073741824" returned: 0 in 1.243s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:46 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde Jul 08 16:35:46 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:46 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 1.138s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:46 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:46 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:47 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde" returned: 0 in 0.755s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c6757a-e781-432c-846e-7e23823dde05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f93ddf-5534-46d9-b183-cfb35f06ebde', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d3790e-5c77-4199-9fa2-8ad885f87627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Volume volume-30f93ddf-5534-46d9-b183-cfb35f06ebde (30f93ddf-5534-46d9-b183-cfb35f06ebde): created successfully Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d3790e-5c77-4199-9fa2-8ad885f87627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (3b6e586a-c715-476f-bd8d-31e4ff3f5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3c816608-1a4a-4158-83b2-ef4cd0949eb8 tempest-ProjectReaderTests-1110733727 None] Created volume successfully. Jul 08 16:35:47 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 1.109s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:47 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3 Jul 08 16:35:47 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:48 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654.d19016d9-5af7-4221-a6d7-4d44afbb18a3" returned: 0 in 0.700s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-d19016d9-5af7-4221-a6d7-4d44afbb18a3" released by "_delete_snapshot" :: held 4.099s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" released by "delete_snapshot" :: held 4.140s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Created reservations ['9f42ac02-a077-4c1c-ab37-63ce1cacaefe', '24114a0f-ee85-42a4-a828-7592e11f2c01', '4d8d9d40-7fea-474b-9ff9-ebe491bd2aaa', '2a445379-c182-43a1-a84e-2231c976c0d9'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Delete snapshot completed successfully. Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df6624cf-ffda-43e2-a0cf-a253dd1ba7b1 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-d19016d9-5af7-4221-a6d7-4d44afbb18a3-delete_snapshot" released by "delete_snapshot" :: held 4.359s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-30f93ddf-5534-46d9-b183-cfb35f06ebde-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "cinder-30f93ddf-5534-46d9-b183-cfb35f06ebde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-quobyte-30f93ddf-5534-46d9-b183-cfb35f06ebde" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-30f93ddf-5534-46d9-b183-cfb35f06ebde" acquired by "delete_volume" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91a438-9a4a-4975-91f4-9edd4ff7979a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:48 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde Jul 08 16:35:48 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:49 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde" returned: 0 in 0.831s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:49 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde Jul 08 16:35:49 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-b2791260-bc2d-44d2-9156-fbfd5f40f654-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-b2791260-bc2d-44d2-9156-fbfd5f40f654-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d03f7-d82a-4904-b1fe-c75e182084c9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:49 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:49 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9b161a5a-eb5a-42de-be89-1cb11f395b91 tempest-ProjectAdminTests-282933647 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940689086914, 'free_capacity_gb': 1775.6940689086914, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87227) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 16:35:50 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-30f93ddf-5534-46d9-b183-cfb35f06ebde" returned: 0 in 0.764s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-30f93ddf-5534-46d9-b183-cfb35f06ebde" released by "delete_volume" :: held 1.652s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Created reservations ['56938fa2-896a-4d2c-ad2e-4699d2a94b13', 'd413a0d7-2931-46ce-b15b-f7fe56223a56', '8f86cabe-ced9-4530-b4fe-cc84e829203c', '5deb7087-cd97-440c-aaca-61606b1673fb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:50 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:50 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:50 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 0.851s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:50 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654 Jul 08 16:35:50 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:51 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.933s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:51 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Deleted volume successfully. Jul 08 16:35:51 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b2791260-bc2d-44d2-9156-fbfd5f40f654" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0f3effb9-7bfb-4426-9ed8-3afe08dfa4ea tempest-ProjectReaderTests-1110733727 None] Lock "cinder-30f93ddf-5534-46d9-b183-cfb35f06ebde-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-b2791260-bc2d-44d2-9156-fbfd5f40f654" released by "delete_volume" :: held 1.786s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Created reservations ['30a1d1f8-4d12-424d-91ca-51037114fd76', '8f3b8430-f7c8-42e8-9d14-f980f4154c81', '1092ea76-0e25-40f4-8a62-5b70846c6615', '942ecac5-d3b5-4b4e-a343-2e2107c74023'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (a55de30a-eb53-4371-a4a9-c7974620bf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd85f87-d736-439e-8b30-3c33e6cd7215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd85f87-d736-439e-8b30-3c33e6cd7215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306127174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fe32fa-dace-4658-99fc-598ae5fbff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:51Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4237b0e7-726b-4b7a-a265-7988237741cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4237b0e7-726b-4b7a-a265-7988237741cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840c56ae-96d8-4387-a15c-d908f88ff85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840c56ae-96d8-4387-a15c-d908f88ff85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fe32fa-dace-4658-99fc-598ae5fbff9d', 'volume_name': 'volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbd5d6b-6485-44eb-9944-5cd366d6aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbd5d6b-6485-44eb-9944-5cd366d6aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a2f74e-f21f-40b7-8786-deb38c8e1549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:51 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Volume c4fe32fa-dace-4658-99fc-598ae5fbff9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d', 'volume_size': 1} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306127174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fe32fa-dace-4658-99fc-598ae5fbff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:51Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Creating volume c4fe32fa-dace-4658-99fc-598ae5fbff9d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:51 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:51 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d 1073741824 Jul 08 16:35:51 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:51 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:51 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-169bd65e-cfc9-4ded-8675-7fce374130dd-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-169bd65e-cfc9-4ded-8675-7fce374130dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d78b0-e485-4060-8d05-1260370a3be8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:52 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd Jul 08 16:35:52 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:52 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 1.211s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Deleted volume successfully. Jul 08 16:35:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f90001c6-7f2d-48ba-aaff-aaf9adb75c33 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-b2791260-bc2d-44d2-9156-fbfd5f40f654-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:53 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d 1073741824" returned: 0 in 1.434s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:53 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d Jul 08 16:35:53 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:53 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd" returned: 0 in 1.372s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:53 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd Jul 08 16:35:53 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:54 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d" returned: 0 in 0.917s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a2f74e-f21f-40b7-8786-deb38c8e1549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297127b1-c4ed-4a17-9b24-efa30f6435a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:54 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Volume volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d (c4fe32fa-dace-4658-99fc-598ae5fbff9d): created successfully Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297127b1-c4ed-4a17-9b24-efa30f6435a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (a55de30a-eb53-4371-a4a9-c7974620bf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:54 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ae47e430-150d-44fa-9137-b05f0e85d998 tempest-ProjectReaderTests-1110733727 None] Created volume successfully. Jul 08 16:35:54 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-169bd65e-cfc9-4ded-8675-7fce374130dd" returned: 0 in 0.834s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-quobyte-169bd65e-cfc9-4ded-8675-7fce374130dd" released by "delete_volume" :: held 2.277s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Created reservations ['13cf5bde-da3c-47ee-a38c-af4f610116b6', '81acd50f-f315-4956-bffc-8c6e2effe800', '07c11a7b-0ca8-44da-bfb6-e5c807776982', '778fbc8e-42df-4c89-b60f-22045e0585f3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:54 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:54 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-c4fe32fa-dace-4658-99fc-598ae5fbff9d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-c4fe32fa-dace-4658-99fc-598ae5fbff9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-quobyte-c4fe32fa-dace-4658-99fc-598ae5fbff9d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-c4fe32fa-dace-4658-99fc-598ae5fbff9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f74d8-66b1-433f-8a68-7188a1a0948d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:55 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d Jul 08 16:35:55 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.725s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Deleted volume successfully. Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b774d73a-7cba-460e-9f04-17bc72f1c343 tempest-VolumeDependencyTests-973030680 None] Lock "cinder-169bd65e-cfc9-4ded-8675-7fce374130dd-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:55 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d" returned: 0 in 0.937s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:55 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d Jul 08 16:35:56 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:56 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c4fe32fa-dace-4658-99fc-598ae5fbff9d" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-c4fe32fa-dace-4658-99fc-598ae5fbff9d" released by "delete_volume" :: held 1.781s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Created reservations ['178612e3-3757-4d48-8080-85dd012e7bf1', '704e4569-cab1-4b7e-8809-847f19ae4721', 'f83cd4e2-ea3c-4766-9381-aa3ebd3443eb', '85b0c22b-5f77-4f71-a8c2-94db23bb1f2d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:56 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:35:56 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:35:57 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (7a6e93d2-ca22-4063-8002-9cf905a3f64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00fa6f5-c8b8-4cd9-8fc7-01b6bb210b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.895s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:35:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Deleted volume successfully. Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00fa6f5-c8b8-4cd9-8fc7-01b6bb210b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855675395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73026ae1-3475-4777-9e6f-f328497c11ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:58Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7d2465-de25-484d-9c00-6fab680785fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7d2465-de25-484d-9c00-6fab680785fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0735b6ce-9cc9-4cb2-ab1d-1b468c445186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0735b6ce-9cc9-4cb2-ab1d-1b468c445186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73026ae1-3475-4777-9e6f-f328497c11ae', 'volume_name': 'volume-73026ae1-3475-4777-9e6f-f328497c11ae', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c6201-e295-44c7-83be-c6701d6c80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c6201-e295-44c7-83be-c6701d6c80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18cdaa8-344d-41bd-8bff-713fcd25a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:57 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Volume 73026ae1-3475-4777-9e6f-f328497c11ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73026ae1-3475-4777-9e6f-f328497c11ae', 'volume_size': 1} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855675395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73026ae1-3475-4777-9e6f-f328497c11ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:35:58Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Creating volume 73026ae1-3475-4777-9e6f-f328497c11ae {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:35:57 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f64653c0-86f3-4f49-bb1a-1fc141b195d7 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-c4fe32fa-dace-4658-99fc-598ae5fbff9d-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:35:57 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae 1073741824 Jul 08 16:35:57 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:58 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae 1073741824" returned: 0 in 0.962s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:35:58 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae Jul 08 16:35:58 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:35:59 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18cdaa8-344d-41bd-8bff-713fcd25a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73026ae1-3475-4777-9e6f-f328497c11ae', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef08eba-45c5-45fa-bc6c-0a211a6197e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:35:59 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Volume volume-73026ae1-3475-4777-9e6f-f328497c11ae (73026ae1-3475-4777-9e6f-f328497c11ae): created successfully Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef08eba-45c5-45fa-bc6c-0a211a6197e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:35:59 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (7a6e93d2-ca22-4063-8002-9cf905a3f64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:35:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-146669f8-1183-4880-8726-c025abb8b61e tempest-ProjectReaderTests-1110733727 None] Created volume successfully. Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-73026ae1-3475-4777-9e6f-f328497c11ae-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "cinder-73026ae1-3475-4777-9e6f-f328497c11ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-quobyte-73026ae1-3475-4777-9e6f-f328497c11ae" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (dd24a7fd-9114-4c4c-8cd5-bb5409cc5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f0ee87-3836-44e7-a5f6-c3cbae30df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-73026ae1-3475-4777-9e6f-f328497c11ae" acquired by "delete_volume" :: waited 0.078s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[e718b353-038a-4750-8d18-27acf58a5f8b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f0ee87-3836-44e7-a5f6-c3cbae30df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135651003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9286099-5e91-443b-a0ad-390def033ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f0bbce-e0dc-4c4f-9ec8-b1f37a560d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f0bbce-e0dc-4c4f-9ec8-b1f37a560d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d5d6a4-23de-440a-a16a-7fe77591d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d5d6a4-23de-440a-a16a-7fe77591d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9286099-5e91-443b-a0ad-390def033ae5', 'volume_name': 'volume-c9286099-5e91-443b-a0ad-390def033ae5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0693cffb-5087-4bdc-83fe-02f1060ed90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0693cffb-5087-4bdc-83fe-02f1060ed90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7ef19d-11ad-4022-a614-8b1f5e3615fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Volume c9286099-5e91-443b-a0ad-390def033ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9286099-5e91-443b-a0ad-390def033ae5', 'volume_size': 1} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135651003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9286099-5e91-443b-a0ad-390def033ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Creating volume c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:01 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:01 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 1073741824 Jul 08 16:36:01 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:01 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae Jul 08 16:36:01 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:02 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae" returned: 0 in 1.082s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:02 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae Jul 08 16:36:02 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:02 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 1073741824" returned: 0 in 1.180s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:02 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 Jul 08 16:36:02 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (a5cc53bb-d1b8-4d06-9fe1-682e7cbbdcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcb41d-48f1-4c48-9a24-929338fce276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcb41d-48f1-4c48-9a24-929338fce276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146109352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7832c6da-0c74-48a9-9adc-2b43946bbd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:03Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba573ab-6178-40b3-8af5-2a71b8b7a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba573ab-6178-40b3-8af5-2a71b8b7a90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8698c696-4afc-49fd-94d2-3b3a0d3c8dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8698c696-4afc-49fd-94d2-3b3a0d3c8dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7832c6da-0c74-48a9-9adc-2b43946bbd08', 'volume_name': 'volume-7832c6da-0c74-48a9-9adc-2b43946bbd08', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02724171-f67a-497c-9deb-56bd1baad71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02724171-f67a-497c-9deb-56bd1baad71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b3dcfc-1cad-48d8-b2e4-b0678111c4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Volume 7832c6da-0c74-48a9-9adc-2b43946bbd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7832c6da-0c74-48a9-9adc-2b43946bbd08', 'volume_size': 1} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:03 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-73026ae1-3475-4777-9e6f-f328497c11ae" returned: 0 in 0.816s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-73026ae1-3475-4777-9e6f-f328497c11ae" released by "delete_volume" :: held 1.952s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Created reservations ['446aa246-bfa1-4bf3-983a-bebd013584ea', '04de444f-0dbb-4c86-8714-727e604600a2', '4b838f39-83c1-460e-8f65-4586081bf306', 'e52985c7-ae4d-4031-8c37-98dfd34f13ec'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:03 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:03 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:03 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146109352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7832c6da-0c74-48a9-9adc-2b43946bbd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:03Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Creating volume 7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:03 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:03 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 1073741824 Jul 08 16:36:03 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7ef19d-11ad-4022-a614-8b1f5e3615fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9286099-5e91-443b-a0ad-390def033ae5', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39a8259-14c0-41eb-8dd0-740123ed1607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Volume volume-c9286099-5e91-443b-a0ad-390def033ae5 (c9286099-5e91-443b-a0ad-390def033ae5): created successfully Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39a8259-14c0-41eb-8dd0-740123ed1607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (dd24a7fd-9114-4c4c-8cd5-bb5409cc5296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a6e8e3d0-3848-4907-9ac1-b67a9c5c7ba8 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (66d97ba5-bafc-4bb1-9173-3ed892b7381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc50adc6-7b9c-4032-a535-414b3b0d442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc50adc6-7b9c-4032-a535-414b3b0d442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174863373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b3a934-641c-44bf-bf1a-bad0ab30d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:04Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af79ab-998c-4c48-b934-b9ca022b42fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:03 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af79ab-998c-4c48-b934-b9ca022b42fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482a9d9a-760d-4539-a37a-addc1880a868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482a9d9a-760d-4539-a37a-addc1880a868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b3a934-641c-44bf-bf1a-bad0ab30d51e', 'volume_name': 'volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe147a-35d2-495b-9b90-95630fa9f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe147a-35d2-495b-9b90-95630fa9f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223dd88e-8c53-48bc-9842-906e1eff2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:04 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Volume b8b3a934-641c-44bf-bf1a-bad0ab30d51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e', 'volume_size': 1} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:04 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.796s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:04 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Deleted volume successfully. Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-08a29d42-f618-442b-a432-a99a911be56b tempest-ProjectReaderTests-1110733727 None] Lock "cinder-73026ae1-3475-4777-9e6f-f328497c11ae-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:04 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 1073741824" returned: 0 in 1.047s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:04 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 Jul 08 16:36:04 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:05 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174863373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b3a934-641c-44bf-bf1a-bad0ab30d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8667c0604ce583957b1ca5a6aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:04Z,use_quota=True,user_id='ed50ecdf9bf445aaa1d7e52f45eb84db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Creating volume b8b3a934-641c-44bf-bf1a-bad0ab30d51e {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:05 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b3dcfc-1cad-48d8-b2e4-b0678111c4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7832c6da-0c74-48a9-9adc-2b43946bbd08', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2d5d50-e213-47c2-bbd0-0b16da18ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:05 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e 1073741824 Jul 08 16:36:05 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:05 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Volume volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 (7832c6da-0c74-48a9-9adc-2b43946bbd08): created successfully Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2d5d50-e213-47c2-bbd0-0b16da18ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:05 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (a5cc53bb-d1b8-4d06-9fe1-682e7cbbdcdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7eab9937-93a4-482e-ac77-fc32edc968a2 tempest-ProjectReaderTests-494057707 None] Created volume successfully. Jul 08 16:36:06 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e 1073741824" returned: 0 in 0.991s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:06 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e Jul 08 16:36:06 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:07 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.435s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 0837e7dd-ded8-4344-81bf-84337aed44d7 of volume c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223dd88e-8c53-48bc-9842-906e1eff2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26628922-f51c-4e0d-a576-0e9977d42f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb98df-0aa1-41c7-9176-b2fad45c7c6b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:07 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Volume volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e (b8b3a934-641c-44bf-bf1a-bad0ab30d51e): created successfully Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26628922-f51c-4e0d-a576-0e9977d42f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Flow 'volume_create_manager' (66d97ba5-bafc-4bb1-9173-3ed892b7381f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-87d9daca-3fd2-4db4-a7ee-936df6810300 tempest-ProjectReaderTests-1110733727 None] Created volume successfully. Jul 08 16:36:07 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 Jul 08 16:36:07 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:07 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5" returned: 0 in 0.812s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:08 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 1G Jul 08 16:36:08 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-b8b3a934-641c-44bf-bf1a-bad0ab30d51e-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-b8b3a934-641c-44bf-bf1a-bad0ab30d51e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "cinder-quobyte-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e6d87-074a-439f-b0e0-3624294088d4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:08 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e Jul 08 16:36:08 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:08 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 1G" returned: 0 in 0.916s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9286099-5e91-443b-a0ad-390def033ae5 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:08 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9286099-5e91-443b-a0ad-390def033ae5 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 Jul 08 16:36:08 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:09 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" returned: 0 in 0.900s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:09 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e Jul 08 16:36:09 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:09 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9286099-5e91-443b-a0ad-390def033ae5 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7" returned: 0 in 0.768s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:09 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 is being set with open permissions: ugo+rw Jul 08 16:36:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:09 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 Jul 08 16:36:09 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:09 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" returned: 0 in 0.715s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-quobyte-b8b3a934-641c-44bf-bf1a-bad0ab30d51e" released by "delete_volume" :: held 1.680s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Created reservations ['ad8a9183-49c9-4723-83cf-5fc269ca932c', '166fe19f-f611-410c-923c-17b83cbdb957', 'a4d1ddf0-99ea-4e84-9fcf-56f67e7e7ecf', '15ab9de8-d968-4467-b0ec-2e11a2ed11f1'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:10 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:10 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:10 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7" returned: 0 in 0.718s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:10 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info Jul 08 16:36:10 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:10 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.828s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:10 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Deleted volume successfully. Jul 08 16:36:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-0e5d5d1d-3366-4eb0-bcec-b909120e2535 tempest-ProjectReaderTests-1110733727 None] Lock "cinder-b8b3a934-641c-44bf-bf1a-bad0ab30d51e-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:11 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info" returned: 0 in 0.779s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:11 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info is being set with open permissions: ugo+rw Jul 08 16:36:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:11 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info Jul 08 16:36:11 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:11 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.info" returned: 0 in 0.790s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.881s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.671s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Creating offline snapshot bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 of volume 7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3d7cb544-d357-4d9d-8d0b-1a56a6e2a30d tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf20641-2275-49f8-99b5-e6f51d218826]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:12 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 Jul 08 16:36:12 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:12 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08" returned: 0 in 0.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:12 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 1G Jul 08 16:36:12 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-0837e7dd-ded8-4344-81bf-84337aed44d7-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-0837e7dd-ded8-4344-81bf-84337aed44d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-0837e7dd-ded8-4344-81bf-84337aed44d7" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-0837e7dd-ded8-4344-81bf-84337aed44d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 0837e7dd-ded8-4344-81bf-84337aed44d7 of volume c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[86251f6c-eebf-4d5b-ae1e-0cc6a147f0bf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:13 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 Jul 08 16:36:13 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:13 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 1G" returned: 0 in 1.009s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:13 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 Jul 08 16:36:13 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:14 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7" returned: 0 in 0.877s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9286099-5e91-443b-a0ad-390def033ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576bc41-e2f6-421b-83fd-e4140dcbd82e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:14 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 Jul 08 16:36:14 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:14 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" returned: 0 in 0.740s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:14 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 is being set with open permissions: ugo+rw Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:14 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 Jul 08 16:36:14 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:14 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5" returned: 0 in 0.890s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:15 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 Jul 08 16:36:15 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:15 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" returned: 0 in 0.787s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:15 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info Jul 08 16:36:15 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:15 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7" returned: 0 in 0.902s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:15 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7 Jul 08 16:36:15 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:16 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:16 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info is being set with open permissions: ugo+rw Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:16 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info Jul 08 16:36:16 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:16 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5.0837e7dd-ded8-4344-81bf-84337aed44d7" returned: 0 in 0.692s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-0837e7dd-ded8-4344-81bf-84337aed44d7" released by "_delete_snapshot" :: held 3.503s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" released by "delete_snapshot" :: held 3.530s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Created reservations ['73aa8dd0-ad33-46f9-817e-8b7f3c61f628', 'df82fc71-5a87-4340-8a81-eb1a4f49b521', '6166c676-165e-4e9c-8608-3feabd335bbc', '0dd7b73a-0cc6-4f43-8a40-e3b3baf184a2'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6c3c17a9-654d-4490-a5de-574dd7473df3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-0837e7dd-ded8-4344-81bf-84337aed44d7-delete_snapshot" released by "delete_snapshot" :: held 3.700s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:16 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.info" returned: 0 in 0.697s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c1ecc645-99ae-4a5a-9c15-98510bf9ce2f tempest-ProjectReaderTests-494057707 None] Create snapshot completed successfully Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-c9286099-5e91-443b-a0ad-390def033ae5-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "cinder-c9286099-5e91-443b-a0ad-390def033ae5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a572fcdf-8bbb-4b6e-a134-db9c6e90ccfa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:17 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 Jul 08 16:36:17 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:18 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5" returned: 0 in 0.826s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:18 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5 Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Deleting offline snapshot bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 of volume 7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:18 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] snapshot_file for this snap is: volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[636aaa7e-d741-49df-8666-24daf8dea047]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:18 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 Jul 08 16:36:18 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:19 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-c9286099-5e91-443b-a0ad-390def033ae5" returned: 0 in 0.813s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-c9286099-5e91-443b-a0ad-390def033ae5" released by "delete_volume" :: held 1.708s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Created reservations ['a2376045-4c47-4d94-b236-c9a08e01443a', '377ea6c0-91ab-44a9-9893-a946448cc0ee', '13389e40-5b73-49d2-bf99-80bd01adf074', '4a0f8044-bff5-4760-a7ce-829de02ae1fd'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:19 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" returned: 0 in 0.989s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7832c6da-0c74-48a9-9adc-2b43946bbd08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:19 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:19 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ec1ca-589a-4412-b935-6e8c2a91f7c0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:19 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:19 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:19 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 Jul 08 16:36:19 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:20 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.725s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fd94b4b9-9910-401d-a547-acbf512191bc tempest-ProjectMemberTests-1193250347 None] Lock "cinder-c9286099-5e91-443b-a0ad-390def033ae5-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (bda66c26-77ee-459a-856f-97d3db98b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285348e0-17e2-46f6-a170-7f5cc9badd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285348e0-17e2-46f6-a170-7f5cc9badd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297293149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c70104-1b9d-48d1-a641-7256f85b154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:20Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:20 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273423ab-1467-4b06-b56b-5ff3b0238bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273423ab-1467-4b06-b56b-5ff3b0238bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1243a6ed-b9b0-4a37-8b53-8f166b099c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1243a6ed-b9b0-4a37-8b53-8f166b099c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c70104-1b9d-48d1-a641-7256f85b154b', 'volume_name': 'volume-08c70104-1b9d-48d1-a641-7256f85b154b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82922e21-673f-4e4c-b5e6-30962f4eaf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82922e21-673f-4e4c-b5e6-30962f4eaf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac2939e-10a1-45d8-9f0a-f06c05c65b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:20 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Volume 08c70104-1b9d-48d1-a641-7256f85b154b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c70104-1b9d-48d1-a641-7256f85b154b', 'volume_size': 1} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297293149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c70104-1b9d-48d1-a641-7256f85b154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:20Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Creating volume 08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:20 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.997s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:36:20 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b 1073741824 Jul 08 16:36:20 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:20 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08" returned: 0 in 1.255s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:20 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 Jul 08 16:36:20 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:21 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b 1073741824" returned: 0 in 0.943s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:21 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b Jul 08 16:36:21 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:21 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" returned: 0 in 0.855s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:21 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667 Jul 08 16:36:21 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:22 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b" returned: 0 in 0.714s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac2939e-10a1-45d8-9f0a-f06c05c65b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c70104-1b9d-48d1-a641-7256f85b154b', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c588efe-5057-4d2c-8503-4d7e2185d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:22 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Volume volume-08c70104-1b9d-48d1-a641-7256f85b154b (08c70104-1b9d-48d1-a641-7256f85b154b): created successfully Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c588efe-5057-4d2c-8503-4d7e2185d85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (bda66c26-77ee-459a-856f-97d3db98b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:22 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08.bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" returned: 0 in 0.711s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9aa9dff8-e5a3-43f3-bf5c-570ab4516422 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667" released by "_delete_snapshot" :: held 3.936s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" released by "delete_snapshot" :: held 3.965s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Created reservations ['bccb6b8a-7053-4369-a083-595da096a56a', 'fe986903-6070-4afd-b080-82e5a36af9cd', 'ce8647b9-0e65-4258-8e35-0be9b15a40f2', '80d00c22-59d6-40e0-9e3c-7ee496a89e5f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:22 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Delete snapshot completed successfully. Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-f1b9c691-2833-4343-beb3-798b0e749273 tempest-ProjectReaderTests-494057707 None] Lock "cinder-bfe596d0-8a62-4e46-8e2d-31fdb6ffe667-delete_snapshot" released by "delete_snapshot" :: held 4.166s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot b57ce386-9838-4a82-aac9-d3aecd9fe1e6 of volume 08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-7832c6da-0c74-48a9-9adc-2b43946bbd08-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "cinder-7832c6da-0c74-48a9-9adc-2b43946bbd08-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd64817-3cae-4936-b11e-60dead981308]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b16593-34a6-4e3b-a4ca-27e58aef7055]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:22 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b Jul 08 16:36:22 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:22 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 Jul 08 16:36:22 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:23 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b" returned: 0 in 0.875s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:23 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 1G Jul 08 16:36:23 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:23 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:23 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08 Jul 08 16:36:23 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:24 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-7832c6da-0c74-48a9-9adc-2b43946bbd08" returned: 0 in 0.740s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-7832c6da-0c74-48a9-9adc-2b43946bbd08" released by "delete_volume" :: held 1.671s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:24 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 1G" returned: 0 in 0.915s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c70104-1b9d-48d1-a641-7256f85b154b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Created reservations ['b6b79d94-a1a0-4e59-8a2b-3319d710c3be', 'cf307ebf-300c-4b76-a841-2887c2b1b7ac', '57602799-25f5-45ef-ad50-126f705bf311', '35f298fe-aab6-450d-800d-478767cf7b3d'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:24 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c70104-1b9d-48d1-a641-7256f85b154b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 Jul 08 16:36:24 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:24 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:24 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:25 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c70104-1b9d-48d1-a641-7256f85b154b -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6" returned: 0 in 0.837s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:25 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 is being set with open permissions: ugo+rw Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:25 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.773s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:25 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 Jul 08 16:36:25 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Deleted volume successfully. Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-2b30bb9b-7067-4789-9edf-b8436cee3b7a tempest-ProjectReaderTests-494057707 None] Lock "cinder-7832c6da-0c74-48a9-9adc-2b43946bbd08-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (1b8e0bc7-c9d0-4d69-bf10-a34aaa78bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab2d364-3ee5-48bd-824d-b69f89aea6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab2d364-3ee5-48bd-824d-b69f89aea6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842776618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be602567-6f1a-4155-8263-1a43f22bd625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:25Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae4c0f3-a49d-4e08-9a9c-0fa913b8b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae4c0f3-a49d-4e08-9a9c-0fa913b8b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1205e3f-10e0-4b48-87a3-36b63652fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1205e3f-10e0-4b48-87a3-36b63652fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be602567-6f1a-4155-8263-1a43f22bd625', 'volume_name': 'volume-be602567-6f1a-4155-8263-1a43f22bd625', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e597f5-7e87-4814-8295-36bbe400a9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e597f5-7e87-4814-8295-36bbe400a9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ba3937-ebf0-4437-8885-8bf3c874d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Volume be602567-6f1a-4155-8263-1a43f22bd625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be602567-6f1a-4155-8263-1a43f22bd625', 'volume_size': 1} Jul 08 16:36:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:26 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6" returned: 0 in 0.799s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:26 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info Jul 08 16:36:26 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:26 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info" returned: 0 in 0.669s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:26 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info is being set with open permissions: ugo+rw Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:26 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info Jul 08 16:36:26 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Flow 'volume_create_manager' (3730c331-fa53-4c30-a61a-9f25c690a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69757078-8b68-4bea-907f-7d04b2235a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69757078-8b68-4bea-907f-7d04b2235a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-617595153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babe7872-5dc3-422e-a4c8-5f9e97f58ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3488dc00b75143beb814d711129ac179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:27Z,use_quota=True,user_id='d57e3e8cdec942a18de278e88b4ce22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207c7c48-b927-468b-a1a1-974b5b0f18b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207c7c48-b927-468b-a1a1-974b5b0f18b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4155d612-3f50-4e3d-978e-90db892aa758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4155d612-3f50-4e3d-978e-90db892aa758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babe7872-5dc3-422e-a4c8-5f9e97f58ba9', 'volume_name': 'volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb25952-902b-4601-aa28-04a54cd031d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb25952-902b-4601-aa28-04a54cd031d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cefe00-7164-44d0-852e-1157a574df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:26 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Volume babe7872-5dc3-422e-a4c8-5f9e97f58ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9', 'volume_size': 1} Jul 08 16:36:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:27 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.info" returned: 0 in 0.642s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.858s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842776618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be602567-6f1a-4155-8263-1a43f22bd625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:25Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Creating volume be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:27 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:27 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 1073741824 Jul 08 16:36:27 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6b452e7c-5e0e-4daa-9039-e0d6aa84daf0 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-b57ce386-9838-4a82-aac9-d3aecd9fe1e6-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-b57ce386-9838-4a82-aac9-d3aecd9fe1e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-b57ce386-9838-4a82-aac9-d3aecd9fe1e6" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b57ce386-9838-4a82-aac9-d3aecd9fe1e6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot b57ce386-9838-4a82-aac9-d3aecd9fe1e6 of volume 08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a07560-3d77-48a7-baf1-43355876d31b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:27 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 Jul 08 16:36:27 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:28 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 1073741824" returned: 0 in 0.815s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:28 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 Jul 08 16:36:28 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:28 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6" returned: 0 in 0.746s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c70104-1b9d-48d1-a641-7256f85b154b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276184c-3128-481a-b099-644d3d84c47e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:28 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b Jul 08 16:36:28 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:28 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-617595153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babe7872-5dc3-422e-a4c8-5f9e97f58ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3488dc00b75143beb814d711129ac179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:27Z,use_quota=True,user_id='d57e3e8cdec942a18de278e88b4ce22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Creating volume babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:28 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:28 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 1073741824 Jul 08 16:36:28 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ba3937-ebf0-4437-8885-8bf3c874d79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be602567-6f1a-4155-8263-1a43f22bd625', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8613e6-4758-43c6-92d9-fee4ef5e38f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:29 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Volume volume-be602567-6f1a-4155-8263-1a43f22bd625 (be602567-6f1a-4155-8263-1a43f22bd625): created successfully Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8613e6-4758-43c6-92d9-fee4ef5e38f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (1b8e0bc7-c9d0-4d69-bf10-a34aaa78bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-30e5e2b3-3935-42b1-a981-8c35cadca38b tempest-ProjectReaderTests-494057707 None] Created volume successfully. Jul 08 16:36:29 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b" returned: 0 in 0.802s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:29 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 Jul 08 16:36:29 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:29 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 1073741824" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=38,cinder:UPDATE=144,cinder:SELECT=95,cinder:DELETE=11 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:36:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:29 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:29 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:30 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6" returned: 0 in 0.742s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:30 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6 Jul 08 16:36:30 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:30 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.632s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.735s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=111,cinder:UPDATE=134,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cefe00-7164-44d0-852e-1157a574df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1419b2db-8b9c-43c5-bc5f-114af37def0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Creating offline snapshot 1a3b547f-8128-412d-bdea-394311c686ca of volume be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:30 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Volume volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 (babe7872-5dc3-422e-a4c8-5f9e97f58ba9): created successfully Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1419b2db-8b9c-43c5-bc5f-114af37def0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Flow 'volume_create_manager' (3730c331-fa53-4c30-a61a-9f25c690a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fe353-531a-4f72-9e55-da17859f602b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c50bc3a3-4276-4f95-89da-1f9fc25a2b5e tempest-SnapshotDependencyTests-1324127465 None] Created volume successfully. Jul 08 16:36:30 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 Jul 08 16:36:30 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:30 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b.b57ce386-9838-4a82-aac9-d3aecd9fe1e6" returned: 0 in 0.662s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b57ce386-9838-4a82-aac9-d3aecd9fe1e6" released by "_delete_snapshot" :: held 3.063s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" released by "delete_snapshot" :: held 3.092s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:30 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Created reservations ['eee8b1cc-94bd-4869-b959-5a2c603175e1', '0dac87a1-4e21-4ab2-af8b-ce2c3d146f5c', '8b71a97f-5bf5-40ec-bec6-a6dc07f317d7', 'dc0aa44a-306e-400e-bdca-11ba6bb9e125'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:31 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:36:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-b17401cc-c57d-4a99-8195-3bb2724ea5e8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-b57ce386-9838-4a82-aac9-d3aecd9fe1e6-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:31 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625" returned: 0 in 0.853s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:31 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca 1G Jul 08 16:36:31 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-08c70104-1b9d-48d1-a641-7256f85b154b-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-08c70104-1b9d-48d1-a641-7256f85b154b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9723ac-5f4c-45ff-a62e-68d0304421a8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:32 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:32 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca 1G" returned: 0 in 0.872s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:32 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be602567-6f1a-4155-8263-1a43f22bd625 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:32 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be602567-6f1a-4155-8263-1a43f22bd625 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca Jul 08 16:36:32 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:32 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b" returned: 0 in 0.777s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:32 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be602567-6f1a-4155-8263-1a43f22bd625 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:32 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca is being set with open permissions: ugo+rw Jul 08 16:36:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:32 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b Jul 08 16:36:32 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:33 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca Jul 08 16:36:33 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:33 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-08c70104-1b9d-48d1-a641-7256f85b154b" returned: 0 in 0.649s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-08c70104-1b9d-48d1-a641-7256f85b154b" released by "delete_volume" :: held 1.482s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:33 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca" returned: 0 in 0.680s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Created reservations ['fefc7166-74af-4a9e-977f-e9ba3161902a', '807dd8fb-e5df-4b74-a0ba-e915243be3c6', 'c86ecb5e-4aa4-46ac-a6c4-be54f843720e', '007a1539-f2c2-4e3c-a54a-d88bbccef643'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:33 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info Jul 08 16:36:33 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:33 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:33 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:34 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info" returned: 0 in 0.681s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:34 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info is being set with open permissions: ugo+rw Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:34 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info Jul 08 16:36:34 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:34 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.670s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8595ac95-7d36-41a5-b8d6-9172c827b673 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-08c70104-1b9d-48d1-a641-7256f85b154b-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (8957ffd5-c6af-4534-af6d-2f9dc2130af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d153d1-d6e5-4a51-8fe2-03eb36e45629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d153d1-d6e5-4a51-8fe2-03eb36e45629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202035146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b60fc0-ac81-4625-86e7-a6e75bf39c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:35Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a00e1fa-40a3-4ad7-8dea-41da7da1abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a00e1fa-40a3-4ad7-8dea-41da7da1abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0969b01b-9e43-4b0b-9ef8-9ff871ca8989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0969b01b-9e43-4b0b-9ef8-9ff871ca8989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b60fc0-ac81-4625-86e7-a6e75bf39c6a', 'volume_name': 'volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9450994-c073-43ae-a3cb-7408fab11294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9450994-c073-43ae-a3cb-7408fab11294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1362115-a23c-49b2-b1b5-0c0f4e343c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:34 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Volume 45b60fc0-ac81-4625-86e7-a6e75bf39c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a', 'volume_size': 1} Jul 08 16:36:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:35 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.info" returned: 0 in 0.654s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.546s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.763s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Creating offline snapshot c901ca30-bb36-45b0-b8c9-1f710e40d622 of volume babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:35 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-55edf4f6-4950-4c44-ac46-10485007c9fd tempest-ProjectReaderTests-494057707 None] Create snapshot completed successfully Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d52b942-5307-4011-99ca-c2c7c8cb338e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:35 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:35 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:35 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:35 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 1G Jul 08 16:36:35 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-1a3b547f-8128-412d-bdea-394311c686ca-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-1a3b547f-8128-412d-bdea-394311c686ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-1a3b547f-8128-412d-bdea-394311c686ca" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-1a3b547f-8128-412d-bdea-394311c686ca" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Deleting offline snapshot 1a3b547f-8128-412d-bdea-394311c686ca of volume be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] snapshot_file for this snap is: volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48421ec-0ea7-4c64-866b-c080edbbef91]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:36 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca Jul 08 16:36:36 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:36 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 1G" returned: 0 in 0.818s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:36 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:36 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:36 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca" returned: 0 in 0.788s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be602567-6f1a-4155-8263-1a43f22bd625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fa442a-b5aa-43dc-b891-c81b82f0ca5c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:37 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 Jul 08 16:36:37 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:37 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:37 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 is being set with open permissions: ugo+rw Jul 08 16:36:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:37 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:37 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:37 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:37 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca Jul 08 16:36:37 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:38 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.690s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:38 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info Jul 08 16:36:38 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:38 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca" returned: 0 in 0.731s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:38 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca Jul 08 16:36:38 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:38 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info" returned: 0 in 0.673s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:38 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info is being set with open permissions: ugo+rw Jul 08 16:36:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:38 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info Jul 08 16:36:38 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:39 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625.1a3b547f-8128-412d-bdea-394311c686ca" returned: 0 in 0.637s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-1a3b547f-8128-412d-bdea-394311c686ca" released by "_delete_snapshot" :: held 3.012s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" released by "delete_snapshot" :: held 3.032s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Created reservations ['2628f409-3c85-472f-8c21-a46f6ece0aa1', 'de5f4d41-840d-46bf-b289-192c6431273a', 'd3bb6139-df1a-48d5-bfdb-47251fab6f81', '8f4fab68-168b-4cfb-82b0-d34bd469ac52'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Delete snapshot completed successfully. Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4ab5cf05-b115-4753-8b75-0eba46a45a86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-1a3b547f-8128-412d-bdea-394311c686ca-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:39 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.info" returned: 0 in 0.688s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202035146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b60fc0-ac81-4625-86e7-a6e75bf39c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:35Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Creating volume 45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:39 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:39 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a 1073741824 Jul 08 16:36:39 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:39 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-34b15021-2b79-4a81-8f9e-b7681c00bc55 tempest-SnapshotDependencyTests-1324127465 None] Create snapshot completed successfully Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-be602567-6f1a-4155-8263-1a43f22bd625-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "cinder-be602567-6f1a-4155-8263-1a43f22bd625-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:40 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a 1073741824" returned: 0 in 0.824s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba805b-2693-4ee0-9dac-0e567a78ae0e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:40 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a Jul 08 16:36:40 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:40 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 Jul 08 16:36:40 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:41 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" returned: 0 in 0.742s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1362115-a23c-49b2-b1b5-0c0f4e343c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9f40ab-e2f6-4db5-b590-6598f13de375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Volume volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a (45b60fc0-ac81-4625-86e7-a6e75bf39c6a): created successfully Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9f40ab-e2f6-4db5-b590-6598f13de375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (8957ffd5-c6af-4534-af6d-2f9dc2130af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:41 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d00dde73-fcd1-4582-949f-794ef29f910b tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625" returned: 0 in 0.870s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:41 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625 Jul 08 16:36:41 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Flow 'volume_create_manager' (fe51ac8a-6eb5-4bfd-b798-8905e383a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e186c325-0056-4ef6-b3c4-05990570fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e186c325-0056-4ef6-b3c4-05990570fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0401b59b-d36d-4669-9e0b-898b69c0922e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3488dc00b75143beb814d711129ac179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c901ca30-bb36-45b0-b8c9-1f710e40d622,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:41Z,use_quota=True,user_id='d57e3e8cdec942a18de278e88b4ce22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9eb46a-a6f4-4a04-9f61-b7677cc0b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9eb46a-a6f4-4a04-9f61-b7677cc0b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa1fb04-1c81-466b-a7e0-22099c51b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa1fb04-1c81-466b-a7e0-22099c51b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0401b59b-d36d-4669-9e0b-898b69c0922e', 'volume_name': 'volume-0401b59b-d36d-4669-9e0b-898b69c0922e', 'volume_size': 1, 'snapshot_id': 'c901ca30-bb36-45b0-b8c9-1f710e40d622'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de240a5-72ab-44a2-9e28-8b409b34c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de240a5-72ab-44a2-9e28-8b409b34c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ffa1e6-8ab4-420b-8f95-5536e622b208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Volume 0401b59b-d36d-4669-9e0b-898b69c0922e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0401b59b-d36d-4669-9e0b-898b69c0922e', 'volume_size': 1, 'snapshot_id': 'c901ca30-bb36-45b0-b8c9-1f710e40d622'} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622-0401b59b-d36d-4669-9e0b-898b69c0922e" by "_create_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622-0401b59b-d36d-4669-9e0b-898b69c0922e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Creating volume 0401b59b-d36d-4669-9e0b-898b69c0922e from snapshot c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" by "_copy_volume_from_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] snapshot: c901ca30-bb36-45b0-b8c9-1f710e40d622, volume: 0401b59b-d36d-4669-9e0b-898b69c0922e, {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5177e660-2e1e-441e-93f1-d056f71f2eee]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:41 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:41 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:41 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-be602567-6f1a-4155-8263-1a43f22bd625" returned: 0 in 0.684s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-be602567-6f1a-4155-8263-1a43f22bd625" released by "delete_volume" :: held 1.620s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:41 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Created reservations ['383eefeb-c15f-4165-82d4-b993f19d657f', '7cc56980-0f0d-4641-bc4e-6d9d98983ed9', '845eceb0-ddf2-494a-b978-94d46c6d16fb', 'ad4fcb28-ebc6-4bb3-b6ac-efe83b29d8f3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:42 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:42 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:42 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.839s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Creating direct copy from snapshot {{(pid=87227) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4433b4-ec2f-413a-b2b0-522a0a306572]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:42 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:42 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:42 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.739s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:42 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Deleted volume successfully. Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9007c29c-0f6f-4d75-9535-31c6cb090c9b tempest-ProjectReaderTests-494057707 None] Lock "cinder-be602567-6f1a-4155-8263-1a43f22bd625-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:36:42 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (f761cd00-a391-4b3b-a704-1174b5ab3cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6137f5f9-31ce-40bd-9eee-f2606955b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6137f5f9-31ce-40bd-9eee-f2606955b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358604663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcbb8cc-0f16-4409-b864-87ff4a988344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:43Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3492dfa-6b5c-457b-85a2-c5b6b4e828de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3492dfa-6b5c-457b-85a2-c5b6b4e828de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7387bab4-9e7c-41ad-b320-14fa38e23012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7387bab4-9e7c-41ad-b320-14fa38e23012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcbb8cc-0f16-4409-b864-87ff4a988344', 'volume_name': 'volume-4dcbb8cc-0f16-4409-b864-87ff4a988344', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df086d9f-13d9-41da-8a41-caeef883cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df086d9f-13d9-41da-8a41-caeef883cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1644e0-8c5a-4174-aec2-2b26e259ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Volume 4dcbb8cc-0f16-4409-b864-87ff4a988344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcbb8cc-0f16-4409-b864-87ff4a988344', 'volume_size': 1} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:43 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.823s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG cinder.utils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Path /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e not found in is_blk_device check {{(pid=87227) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 16:36:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:43 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e Jul 08 16:36:43 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:47 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e" returned: 0 in 4.500s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:47 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c2defe-2b95-48b2-92e7-d6b02126b5d0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:47 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:47 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:48 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.893s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:48 devstack cinder-volume[87227]: DEBUG cinder.image.image_utils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e {{(pid=87227) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 16:36:48 devstack cinder-volume[87227]: INFO cinder.image.image_utils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Converted 1024.00 MB image at 227.51 MB/s Jul 08 16:36:48 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e is being set with open permissions: ugo+rw Jul 08 16:36:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:48 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e Jul 08 16:36:48 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:49 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e" returned: 0 in 0.625s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" released by "_copy_volume_from_snapshot" :: held 7.794s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622-0401b59b-d36d-4669-9e0b-898b69c0922e" released by "_create_volume_from_snapshot" :: held 7.827s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.847s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.817s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot acedde11-1d95-4da9-b041-9e76a2ad2769 of volume 45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ffa1e6-8ab4-420b-8f95-5536e622b208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0401b59b-d36d-4669-9e0b-898b69c0922e', 'volume_size': 1, 'snapshot_id': 'c901ca30-bb36-45b0-b8c9-1f710e40d622'}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5e7a71-6976-486f-99ff-d473d2448cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57ac38e-f152-4ae0-b9bc-38d2dcdaaff4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:49 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Volume volume-0401b59b-d36d-4669-9e0b-898b69c0922e (0401b59b-d36d-4669-9e0b-898b69c0922e): created successfully Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5e7a71-6976-486f-99ff-d473d2448cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Flow 'volume_create_manager' (fe51ac8a-6eb5-4bfd-b798-8905e383a6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:49 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-73ee89f9-2e26-4576-9706-70d64c690018 tempest-SnapshotDependencyTests-1324127465 None] Created volume successfully. Jul 08 16:36:49 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a Jul 08 16:36:49 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-c901ca30-bb36-45b0-b8c9-1f710e40d622-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-c901ca30-bb36-45b0-b8c9-1f710e40d622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:50 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" returned: 0 in 0.748s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Deleting offline snapshot c901ca30-bb36-45b0-b8c9-1f710e40d622 of volume babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:50 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 1G Jul 08 16:36:50 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] snapshot_file for this snap is: volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15a650f-c241-4193-aa2e-51e5decd6325]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:50 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:50 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:50 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:50 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.789s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 1G" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a111e-52a8-4d4f-90c1-bc92f141b806]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:50 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 Jul 08 16:36:50 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:51 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:51 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:51 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:51 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 is being set with open permissions: ugo+rw Jul 08 16:36:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:51 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 Jul 08 16:36:51 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:51 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.768s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:51 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:51 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:52 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769" returned: 0 in 0.647s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:52 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info Jul 08 16:36:52 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:52 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.771s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:52 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622 Jul 08 16:36:52 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:52 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info" returned: 0 in 0.666s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:52 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info is being set with open permissions: ugo+rw Jul 08 16:36:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:52 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info Jul 08 16:36:52 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:53 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9.c901ca30-bb36-45b0-b8c9-1f710e40d622" returned: 0 in 0.633s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-c901ca30-bb36-45b0-b8c9-1f710e40d622" released by "_delete_snapshot" :: held 3.077s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" released by "delete_snapshot" :: held 3.108s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Created reservations ['21360856-294b-447e-b0e9-fad60a608825', '504d20fe-e888-47f6-b34d-f3c9f83e92bb', 'e471def1-438d-4967-9f6b-a56b05c7e98a', 'a324b854-488e-47c8-b5d1-1c806d91e844'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Delete snapshot completed successfully. Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-01938a04-04b4-4355-9ee8-22c365ea6b3c tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-c901ca30-bb36-45b0-b8c9-1f710e40d622-delete_snapshot" released by "delete_snapshot" :: held 3.247s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:53 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.info" returned: 0 in 0.661s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.536s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358604663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcbb8cc-0f16-4409-b864-87ff4a988344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:36:43Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Creating volume 4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:36:53 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:53 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 1073741824 Jul 08 16:36:53 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-27443e4e-23ec-4255-a649-88c5b84ec301 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-acedde11-1d95-4da9-b041-9e76a2ad2769-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-acedde11-1d95-4da9-b041-9e76a2ad2769-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-acedde11-1d95-4da9-b041-9e76a2ad2769" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-acedde11-1d95-4da9-b041-9e76a2ad2769" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot acedde11-1d95-4da9-b041-9e76a2ad2769 of volume 45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fdd593-d88c-4659-bd03-49502ab72a51]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:54 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 Jul 08 16:36:54 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-babe7872-5dc3-422e-a4c8-5f9e97f58ba9-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-babe7872-5dc3-422e-a4c8-5f9e97f58ba9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d645676-5379-48f8-841a-852e18542115]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:54 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:54 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:54 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 1073741824" returned: 0 in 0.927s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:54 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 Jul 08 16:36:54 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:54 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769" returned: 0 in 0.844s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b15827-e9ce-4a58-9ec3-cda451fcadbb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:54 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a Jul 08 16:36:54 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:55 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.793s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:55 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9 Jul 08 16:36:55 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:55 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344" returned: 0 in 0.669s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1644e0-8c5a-4174-aec2-2b26e259ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcbb8cc-0f16-4409-b864-87ff4a988344', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6fc1a1-74d0-4351-861e-7e1266568061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:36:55 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Volume volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 (4dcbb8cc-0f16-4409-b864-87ff4a988344): created successfully Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6fc1a1-74d0-4351-861e-7e1266568061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (f761cd00-a391-4b3b-a704-1174b5ab3cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:36:55 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-93a2c65d-0696-44c8-919e-4b6584a4270a tempest-ProjectReaderTests-494057707 None] Created volume successfully. Jul 08 16:36:55 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:55 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 Jul 08 16:36:55 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:55 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" returned: 0 in 0.667s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-babe7872-5dc3-422e-a4c8-5f9e97f58ba9" released by "delete_volume" :: held 1.543s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:55 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Created reservations ['254b748c-0f91-45bd-a4a0-c4a5d277353d', 'fc284404-7468-47c6-b30b-094b624998d0', 'e22f4671-e8a8-48fe-a714-75cfb9e26466', '9f895c7c-ccb9-4e35-8947-9af2d0cb512b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:56 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:56 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Creating offline snapshot 21d755a5-4365-4381-808d-b3811753c2f9 of volume 4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8995d7-b68a-4272-bc32-6b0d74d0d9c9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:56 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 Jul 08 16:36:56 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:56 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769" returned: 0 in 0.817s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:56 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769 Jul 08 16:36:56 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-0401b59b-d36d-4669-9e0b-898b69c0922e-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-0401b59b-d36d-4669-9e0b-898b69c0922e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2182a740-76c0-4b63-becb-fa0c0009c7c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:56 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e Jul 08 16:36:56 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:56 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.778s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:56 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Deleted volume successfully. Jul 08 16:36:56 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-12ee17ec-2463-4c1d-b4e0-f7c70eec928a tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-babe7872-5dc3-422e-a4c8-5f9e97f58ba9-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:57 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344" returned: 0 in 0.885s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:57 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 1G Jul 08 16:36:57 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:57 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a.acedde11-1d95-4da9-b041-9e76a2ad2769" returned: 0 in 0.769s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-acedde11-1d95-4da9-b041-9e76a2ad2769" released by "_delete_snapshot" :: held 3.317s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" released by "delete_snapshot" :: held 3.344s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Created reservations ['5d012042-02dd-4e36-8428-c1d7aa1f3f37', 'a2186373-900d-4a0b-8074-1f8fb5b3ed0b', '25ab8e40-d883-420c-986a-fe92db173089', '179bcb01-c96d-4438-b8ac-c056db3e6be8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8248e2bc-5e11-48aa-a7f8-c431c20055f7 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-acedde11-1d95-4da9-b041-9e76a2ad2769-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:57 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e" returned: 0 in 0.860s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:57 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e Jul 08 16:36:57 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:57 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 1G" returned: 0 in 0.837s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:57 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 Jul 08 16:36:57 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-45b60fc0-ac81-4625-86e7-a6e75bf39c6a-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "cinder-45b60fc0-ac81-4625-86e7-a6e75bf39c6a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:58 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-0401b59b-d36d-4669-9e0b-898b69c0922e" returned: 0 in 0.697s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-quobyte-0401b59b-d36d-4669-9e0b-898b69c0922e" released by "delete_volume" :: held 1.615s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[53515a0b-9c39-4000-878d-4207dfc96280]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Created reservations ['18ac0f19-569f-441e-ae64-6a4e53939885', '79fd6623-bf24-4fb0-a1dc-93fb34ceb448', 'b283b0a4-7c14-482a-8114-e1f3d6b42275', '06dc4a03-5a4b-47a6-a85f-6923ac790b0b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:58 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a Jul 08 16:36:58 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:58 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:36:58 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:58 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9" returned: 0 in 0.777s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:58 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 is being set with open permissions: ugo+rw Jul 08 16:36:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:58 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 Jul 08 16:36:58 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:59 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:59 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" returned: 0 in 0.863s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:59 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Deleted volume successfully. Jul 08 16:36:59 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a Jul 08 16:36:59 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-a5c9d520-99c9-44af-8810-32a7bbbecaa4 tempest-SnapshotDependencyTests-1324127465 None] Lock "cinder-0401b59b-d36d-4669-9e0b-898b69c0922e-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:59 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9" returned: 0 in 0.743s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:36:59 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info Jul 08 16:36:59 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:36:59 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" returned: 0 in 0.718s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-45b60fc0-ac81-4625-86e7-a6e75bf39c6a" released by "delete_volume" :: held 1.656s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:36:59 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Created reservations ['3e72f264-eaa8-49cc-9525-3e41728c4b8b', '3b33d12d-abb0-494f-9050-249354b149fe', '66287781-f066-4127-82d4-6dc1da390930', '621d3092-98f8-4fd1-956a-1365b6d66a3b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:00 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:00 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:00 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info" returned: 0 in 0.706s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:00 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info is being set with open permissions: ugo+rw Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:00 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info Jul 08 16:37:00 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:00 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.888s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:00 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-174dbcb8-94e8-41a0-868a-5181c16f0aae tempest-ProjectMemberTests-1193250347 None] Lock "cinder-45b60fc0-ac81-4625-86e7-a6e75bf39c6a-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:01 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (ff270b52-5fd5-441d-ade2-0eb4735972d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90fa93b-99d9-4989-b815-bd9e8c5a22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.info" returned: 0 in 0.886s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.926s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90fa93b-99d9-4989-b815-bd9e8c5a22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64551931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dba46b-a3ef-4b29-8e1b-8129f5766156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b604d76-4996-4932-8289-2ad0b2caa4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b604d76-4996-4932-8289-2ad0b2caa4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cadfdf6-de3b-401c-a16e-712e90f6c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cadfdf6-de3b-401c-a16e-712e90f6c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dba46b-a3ef-4b29-8e1b-8129f5766156', 'volume_name': 'volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcde464-c129-47cb-b424-0324022c15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcde464-c129-47cb-b424-0324022c15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf858a6-2b30-4ea8-870f-c756f2affc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:01 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Volume b6dba46b-a3ef-4b29-8e1b-8129f5766156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156', 'volume_size': 1} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64551931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dba46b-a3ef-4b29-8e1b-8129f5766156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Creating volume b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:01 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:01 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 1073741824 Jul 08 16:37:01 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:01 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-232c810c-4331-4e4b-9b8a-9aebe9bf078e tempest-ProjectReaderTests-494057707 None] Create snapshot completed successfully Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-21d755a5-4365-4381-808d-b3811753c2f9-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-21d755a5-4365-4381-808d-b3811753c2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-21d755a5-4365-4381-808d-b3811753c2f9" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-21d755a5-4365-4381-808d-b3811753c2f9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Deleting offline snapshot 21d755a5-4365-4381-808d-b3811753c2f9 of volume 4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] snapshot_file for this snap is: volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b4e87-fc23-49ac-b969-a50854deab8e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:01 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 Jul 08 16:37:01 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:02 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 1073741824" returned: 0 in 1.015s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:02 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 Jul 08 16:37:02 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:02 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9" returned: 0 in 0.940s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dcbb8cc-0f16-4409-b864-87ff4a988344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb90513-0770-4c2e-a68a-92f6001f021c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:02 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 Jul 08 16:37:02 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:02 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156" returned: 0 in 0.738s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf858a6-2b30-4ea8-870f-c756f2affc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdb36fd-3c72-45d9-ab6e-6ac3ec47a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:02 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Volume volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 (b6dba46b-a3ef-4b29-8e1b-8129f5766156): created successfully Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdb36fd-3c72-45d9-ab6e-6ac3ec47a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (ff270b52-5fd5-441d-ade2-0eb4735972d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:03 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8359346e-cddc-41b7-b829-99e90c4ba193 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:37:03 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344" returned: 0 in 0.907s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:03 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 Jul 08 16:37:03 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:04 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:04 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9 Jul 08 16:37:04 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 of volume b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1610748a-b0a4-4a69-a2f2-f4e3993fb080]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:04 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 Jul 08 16:37:04 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:04 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344.21d755a5-4365-4381-808d-b3811753c2f9" returned: 0 in 0.720s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-21d755a5-4365-4381-808d-b3811753c2f9" released by "_delete_snapshot" :: held 3.505s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" released by "delete_snapshot" :: held 3.534s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Created reservations ['6caf9122-2ee9-4b1b-8a09-df6db0897e80', '1b77b03c-1b73-4dda-9a53-0a45e897e8ab', 'b314d515-7cc8-4fd2-bc82-09ad8b412dd8', '85f41406-e47f-4c88-b0e0-d3e3d45c63c8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:05 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Delete snapshot completed successfully. Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-73c58659-c1bc-4c60-91e5-8ee577c38424 tempest-ProjectReaderTests-494057707 None] Lock "cinder-21d755a5-4365-4381-808d-b3811753c2f9-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:05 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156" returned: 0 in 0.858s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:05 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 1G Jul 08 16:37:05 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-4dcbb8cc-0f16-4409-b864-87ff4a988344-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "cinder-4dcbb8cc-0f16-4409-b864-87ff4a988344-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e19919-f789-4085-a8f4-18e5cfc7f6bb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:05 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 Jul 08 16:37:05 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:06 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 1G" returned: 0 in 0.914s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:06 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 Jul 08 16:37:06 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:06 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344" returned: 0 in 0.890s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:06 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344 Jul 08 16:37:06 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:07 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" returned: 0 in 0.804s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:07 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 is being set with open permissions: ugo+rw Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:07 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 Jul 08 16:37:07 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:07 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-4dcbb8cc-0f16-4409-b864-87ff4a988344" returned: 0 in 0.748s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-4dcbb8cc-0f16-4409-b864-87ff4a988344" released by "delete_volume" :: held 1.721s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Created reservations ['981f0652-1e46-4064-b521-e230515382ea', '79403adf-ef04-440b-9d70-ec47bfc35a9b', '639845fb-6511-43cf-a092-c5a78c254863', '74c400e1-1832-4076-aaa8-9bd038245feb'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:07 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:07 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:07 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" returned: 0 in 0.708s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:07 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info Jul 08 16:37:07 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:08 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.800s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:08 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Deleted volume successfully. Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-c7667616-4bcb-4fd5-8543-616cb1df6c1d tempest-ProjectReaderTests-494057707 None] Lock "cinder-4dcbb8cc-0f16-4409-b864-87ff4a988344-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:08 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (b92a72bf-8d48-4841-a5cf-7b21e6d8e0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c27b4c2-c707-4586-98c2-d060799269fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info" returned: 0 in 0.861s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:08 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info is being set with open permissions: ugo+rw Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c27b4c2-c707-4586-98c2-d060799269fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889349934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e2701e-e47c-4439-8de4-999bf0bff8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:09Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:08 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info Jul 08 16:37:08 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10bd91d-8da7-4c0b-a632-ecd1c65751b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10bd91d-8da7-4c0b-a632-ecd1c65751b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bee370-8189-40c0-acd9-a5c116b8b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bee370-8189-40c0-acd9-a5c116b8b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e2701e-e47c-4439-8de4-999bf0bff8ac', 'volume_name': 'volume-95e2701e-e47c-4439-8de4-999bf0bff8ac', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e94f13-a982-45e0-b2ee-f9798e9addad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e94f13-a982-45e0-b2ee-f9798e9addad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9f1dba-72f1-4b04-be25-bab359563723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:08 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Volume 95e2701e-e47c-4439-8de4-999bf0bff8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e2701e-e47c-4439-8de4-999bf0bff8ac', 'volume_size': 1} Jul 08 16:37:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:09 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.info" returned: 0 in 0.656s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.895s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889349934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e2701e-e47c-4439-8de4-999bf0bff8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:09Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Creating volume 95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:09 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:09 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac 1073741824 Jul 08 16:37:09 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:09 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-13139b1a-4af8-4ca6-850f-57eb62815e89 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 of volume b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92446c-bddb-4b26-8ab9-f2096f2b961b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:09 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 Jul 08 16:37:09 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:10 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac 1073741824" returned: 0 in 0.833s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:10 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac Jul 08 16:37:10 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:10 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" returned: 0 in 0.796s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc44e4d-d177-422e-a2fc-b5e2932b528e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:10 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 Jul 08 16:37:10 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:10 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac" returned: 0 in 0.645s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9f1dba-72f1-4b04-be25-bab359563723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e2701e-e47c-4439-8de4-999bf0bff8ac', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b4ffa-23b7-4331-8c91-91b91eea0434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:10 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Volume volume-95e2701e-e47c-4439-8de4-999bf0bff8ac (95e2701e-e47c-4439-8de4-999bf0bff8ac): created successfully Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b4ffa-23b7-4331-8c91-91b91eea0434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:10 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (b92a72bf-8d48-4841-a5cf-7b21e6d8e0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:10 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-096dedd5-6b46-475c-a489-fb31b0391d3d tempest-ProjectReaderTests-494057707 None] Created volume successfully. Jul 08 16:37:11 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156" returned: 0 in 0.790s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:11 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 Jul 08 16:37:11 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Creating offline snapshot b4c1fdc7-26d8-4860-9119-6cbcd74260fc of volume 95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5cb5be-98ce-42f2-8cd9-a6bd098a820a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:11 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac Jul 08 16:37:11 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:12 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:12 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508 Jul 08 16:37:12 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:12 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac" returned: 0 in 0.763s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:12 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc 1G Jul 08 16:37:12 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:12 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156.205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" returned: 0 in 0.703s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508" released by "_delete_snapshot" :: held 3.134s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" released by "delete_snapshot" :: held 3.160s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Created reservations ['38af866a-e2ab-47f3-9478-8acdac9756f8', 'a3a42c77-22d2-4e1a-bc42-f391f0276a73', 'e15fed51-d848-40b2-bd17-a54f1c64c6ba', '034dee44-c3fa-4625-92de-b7443444c5f8'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:12 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:37:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-168a1d89-25e7-401a-93e3-fa07e582e2d3 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-205a8ddb-1402-4c01-9f2d-b6e6fbd5c508-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:13 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc 1G" returned: 0 in 0.847s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e2701e-e47c-4439-8de4-999bf0bff8ac -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:13 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e2701e-e47c-4439-8de4-999bf0bff8ac -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc Jul 08 16:37:13 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-b6dba46b-a3ef-4b29-8e1b-8129f5766156-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-b6dba46b-a3ef-4b29-8e1b-8129f5766156-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:13 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c4b5c-0562-45b2-b699-017f324725c6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:14 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 Jul 08 16:37:14 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:14 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e2701e-e47c-4439-8de4-999bf0bff8ac -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc" returned: 0 in 0.721s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:14 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc is being set with open permissions: ugo+rw Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:14 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc Jul 08 16:37:14 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:14 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156" returned: 0 in 0.775s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:14 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156 Jul 08 16:37:14 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:14 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc" returned: 0 in 0.683s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:14 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info Jul 08 16:37:14 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:15 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-b6dba46b-a3ef-4b29-8e1b-8129f5766156" returned: 0 in 0.677s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-b6dba46b-a3ef-4b29-8e1b-8129f5766156" released by "delete_volume" :: held 1.513s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:15 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info" returned: 0 in 0.670s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:15 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info is being set with open permissions: ugo+rw Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Created reservations ['f20dcd56-debe-4f4c-8d92-238893b9a2f4', '9a227a3b-f125-4e4c-9799-72db7e9c8d5a', 'cbd6a9a7-8a64-4606-bcf3-731a82e8a345', 'a5aeed7a-4c69-4059-9e1d-edefa5f67e94'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:15 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info Jul 08 16:37:15 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:15 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:15 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:16 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.info" returned: 0 in 0.741s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:16 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.687s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:37:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ef2daf7a-63ce-4854-bfe1-0a14409e4a61 tempest-ProjectReaderTests-494057707 None] Create snapshot completed successfully Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-28883344-6833-4322-be1f-0ba8c3083993 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-b6dba46b-a3ef-4b29-8e1b-8129f5766156-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (b64d28af-51e8-41c6-8f17-56984e14312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2612dbc0-c365-4e85-b078-569d124c2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2612dbc0-c365-4e85-b078-569d124c2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472596005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:17Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0ea4a-988b-4926-b9d1-0a13c21d1ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0ea4a-988b-4926-b9d1-0a13c21d1ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd97f84c-8a2b-4711-ad29-124305b8f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd97f84c-8a2b-4711-ad29-124305b8f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7', 'volume_name': 'volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc144d2-1f8d-4af2-ab36-18741b491d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc144d2-1f8d-4af2-ab36-18741b491d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21139fbf-8753-47c6-9bc8-8e0c4cb67903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Volume 017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7', 'volume_size': 1} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472596005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:17Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Creating volume 017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:16 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:16 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 1073741824 Jul 08 16:37:16 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-b4c1fdc7-26d8-4860-9119-6cbcd74260fc-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-b4c1fdc7-26d8-4860-9119-6cbcd74260fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-b4c1fdc7-26d8-4860-9119-6cbcd74260fc" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-b4c1fdc7-26d8-4860-9119-6cbcd74260fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Deleting offline snapshot b4c1fdc7-26d8-4860-9119-6cbcd74260fc of volume 95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] snapshot_file for this snap is: volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f5aa0-da3a-418b-854d-21710fd3d1bf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:17 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc Jul 08 16:37:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:17 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 1073741824" returned: 0 in 0.808s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:17 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 Jul 08 16:37:17 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:17 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95e2701e-e47c-4439-8de4-999bf0bff8ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd0f83-ce17-4f76-84f7-0add28847db2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:18 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac Jul 08 16:37:18 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:18 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" returned: 0 in 0.665s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21139fbf-8753-47c6-9bc8-8e0c4cb67903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54efc07-6244-4ac1-b9d5-bfc3a175e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:18 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Volume volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 (017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7): created successfully Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54efc07-6244-4ac1-b9d5-bfc3a175e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (b64d28af-51e8-41c6-8f17-56984e14312e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:18 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4e7fb129-1709-4b69-bf05-77c6376eb030 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:37:18 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac" returned: 0 in 0.786s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:18 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc Jul 08 16:37:18 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 56ad9d7d-f202-48a3-bd72-2943e7079127 of volume 017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c96e30e-4c59-474c-a07b-317a41b9f626]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:18 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 Jul 08 16:37:18 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:19 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:19 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:19 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc" returned: 0 in 0.788s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:19 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc Jul 08 16:37:19 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:19 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" returned: 0 in 0.789s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:19 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 1G Jul 08 16:37:19 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:20 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.664s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:37:20 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac.b4c1fdc7-26d8-4860-9119-6cbcd74260fc" returned: 0 in 0.668s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-b4c1fdc7-26d8-4860-9119-6cbcd74260fc" released by "_delete_snapshot" :: held 3.141s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" released by "delete_snapshot" :: held 3.165s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Created reservations ['1d07d39c-857d-4e77-a5d8-943e79f7ba11', '5e15d054-e66b-41b0-bcbc-21e705fc05a0', 'a0f4aadd-bb5a-4126-818c-969e1c31eb7d', 'ed4cc434-e84d-46c2-a2a2-41178fc63751'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:20 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Delete snapshot completed successfully. Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-1a254dbb-7d63-438c-ad1d-b2e50e8b44ff tempest-ProjectReaderTests-494057707 None] Lock "cinder-b4c1fdc7-26d8-4860-9119-6cbcd74260fc-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:20 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 1G" returned: 0 in 0.855s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:20 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 Jul 08 16:37:20 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:21 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127" returned: 0 in 0.683s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:21 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 is being set with open permissions: ugo+rw Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:21 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 Jul 08 16:37:21 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-95e2701e-e47c-4439-8de4-999bf0bff8ac-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-95e2701e-e47c-4439-8de4-999bf0bff8ac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a5c69-0683-4d7d-af86-1e6cac440433]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:21 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac Jul 08 16:37:21 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:21 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127" returned: 0 in 0.680s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:21 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info Jul 08 16:37:21 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:22 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac" returned: 0 in 0.792s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:22 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac Jul 08 16:37:22 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:22 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info" returned: 0 in 0.666s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:22 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info is being set with open permissions: ugo+rw Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:22 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info Jul 08 16:37:22 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:22 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-95e2701e-e47c-4439-8de4-999bf0bff8ac" returned: 0 in 0.641s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-95e2701e-e47c-4439-8de4-999bf0bff8ac" released by "delete_volume" :: held 1.496s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Created reservations ['ed3a8c0b-585b-4cc3-9a44-f5bea665c74e', 'f04cf948-619f-4631-9d25-4533f9b4c33d', '18ef629f-93a4-4120-a170-6b7b1d01c8b2', '92e5897d-d76b-400e-a95f-7d35b8991eb7'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:23 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:23 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:23 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.info" returned: 0 in 0.663s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-7bcc74a5-26d0-4d84-90d5-5dc1852cb79d tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:37:23 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.660s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:23 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Deleted volume successfully. Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fc3af19a-d81a-4fa4-b425-23b49b5e1e86 tempest-ProjectReaderTests-494057707 None] Lock "cinder-95e2701e-e47c-4439-8de4-999bf0bff8ac-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (23485111-e771-4dbe-b320-7c46ecc26986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8832076c-e821-45ec-b739-3c53c0165d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8832076c-e821-45ec-b739-3c53c0165d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122405908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942657df-2402-4cab-bc57-0877ef263a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:24Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96414e9d-abf3-4653-abbe-7de927ba10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96414e9d-abf3-4653-abbe-7de927ba10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76d4839-b2b6-4f5c-bc52-a51198aad68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76d4839-b2b6-4f5c-bc52-a51198aad68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942657df-2402-4cab-bc57-0877ef263a93', 'volume_name': 'volume-942657df-2402-4cab-bc57-0877ef263a93', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102c572a-d037-4d56-aa48-b18ca6f934ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102c572a-d037-4d56-aa48-b18ca6f934ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7bce63-80a7-4fda-8de6-f07640a0bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:23 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Volume 942657df-2402-4cab-bc57-0877ef263a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942657df-2402-4cab-bc57-0877ef263a93', 'volume_size': 1} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122405908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942657df-2402-4cab-bc57-0877ef263a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb51fcc69d2d472faf2f72187481faa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:24Z,use_quota=True,user_id='5aa969f50f4e42e4be9c0cd4fe0ae7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Creating volume 942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:24 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:24 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 1073741824 Jul 08 16:37:24 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-56ad9d7d-f202-48a3-bd72-2943e7079127-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-56ad9d7d-f202-48a3-bd72-2943e7079127-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-56ad9d7d-f202-48a3-bd72-2943e7079127" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-56ad9d7d-f202-48a3-bd72-2943e7079127" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 56ad9d7d-f202-48a3-bd72-2943e7079127 of volume 017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c914329-b0c7-4859-9367-2254bc8a0ffd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:24 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 Jul 08 16:37:24 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:24 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 1073741824" returned: 0 in 0.806s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:24 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 Jul 08 16:37:24 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:25 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127" returned: 0 in 0.802s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33d642-6ae3-4b5f-b79e-301f28cc9095]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:25 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 Jul 08 16:37:25 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:25 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93" returned: 0 in 0.671s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7bce63-80a7-4fda-8de6-f07640a0bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942657df-2402-4cab-bc57-0877ef263a93', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f964113b-cb13-4784-8d5c-6149d9c7a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:25 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Volume volume-942657df-2402-4cab-bc57-0877ef263a93 (942657df-2402-4cab-bc57-0877ef263a93): created successfully Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f964113b-cb13-4784-8d5c-6149d9c7a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Flow 'volume_create_manager' (23485111-e771-4dbe-b320-7c46ecc26986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e4bdd5af-2c8e-4d5f-a580-93b69e4f05e8 tempest-ProjectReaderTests-494057707 None] Created volume successfully. Jul 08 16:37:25 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" returned: 0 in 0.782s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:25 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 Jul 08 16:37:25 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Creating offline snapshot 81fccf15-6465-4d9d-a003-4a515c755963 of volume 942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d60ef9-645e-4b14-a86f-8ca793b6f237]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:26 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 Jul 08 16:37:26 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:26 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:26 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127 Jul 08 16:37:26 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:27 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93" returned: 0 in 0.806s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:27 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 1G Jul 08 16:37:27 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:27 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7.56ad9d7d-f202-48a3-bd72-2943e7079127" returned: 0 in 0.670s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-56ad9d7d-f202-48a3-bd72-2943e7079127" released by "_delete_snapshot" :: held 3.116s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" released by "delete_snapshot" :: held 3.138s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Created reservations ['34f59e2f-8e39-4709-8bd2-1c2e9907505f', '4d147ad3-355a-429b-966b-67d9c30ab041', '0aa5d542-5c3d-470d-80f3-e0d2eda12e41', '96da4682-ca73-434b-bdda-ff8047a71a8f'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:27 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-ec23c81a-33a5-4687-89e9-906bffef67ca tempest-ProjectMemberTests-1193250347 None] Lock "cinder-56ad9d7d-f202-48a3-bd72-2943e7079127-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:27 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 1G" returned: 0 in 0.815s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942657df-2402-4cab-bc57-0877ef263a93 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:27 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942657df-2402-4cab-bc57-0877ef263a93 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 Jul 08 16:37:27 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" acquired by "delete_volume" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad74e35-91c6-40a1-8e69-756f540b4e6f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:28 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942657df-2402-4cab-bc57-0877ef263a93 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963" returned: 0 in 0.710s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:28 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 is being set with open permissions: ugo+rw Jul 08 16:37:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:28 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 Jul 08 16:37:28 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:28 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 Jul 08 16:37:28 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:29 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:29 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" returned: 0 in 0.759s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:29 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7 Jul 08 16:37:29 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:29 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info Jul 08 16:37:29 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:29 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" returned: 0 in 0.658s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:29 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info" returned: 0 in 0.637s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:29 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info is being set with open permissions: ugo+rw Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7" released by "delete_volume" :: held 1.486s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:29 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info Jul 08 16:37:29 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=106,cinder:UPDATE=141,cinder:DELETE=10,cinder:INSERT=45 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:37:29 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Created reservations ['ca2853f2-76aa-4bf8-8554-f43748273471', '718587ee-24d5-447c-9937-a99c410a9d53', 'd813f89e-347d-4083-9ca5-e14ebd8c2328', '18e44776-9078-4090-b4f3-ff6acd472428'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:30 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:30 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:30 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.info" returned: 0 in 0.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.382s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6eaacfe6-c784-41b8-80f7-c1b16aec9ca3 tempest-ProjectReaderTests-494057707 None] Create snapshot completed successfully Jul 08 16:37:30 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.679s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:30 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:SELECT=128,cinder:INSERT=36,cinder:UPDATE=150,cinder:DELETE=14 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:37:30 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-fb34d78e-753d-46f8-a969-3eca57b3ece8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-017ccc09-d4ee-4cfe-9a7e-2dbcb67755b7-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (34baca80-b226-4e59-ba04-e6f6172fbede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3e639-7ea9-49fb-9a8a-1dcdef647bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3e639-7ea9-49fb-9a8a-1dcdef647bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47185501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc51964-4b17-43c5-ad6c-20c5c49340c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:31Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267cf69f-7691-4c0c-8c9c-4a91b807b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267cf69f-7691-4c0c-8c9c-4a91b807b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6065a6cc-f274-473c-a26c-e631ca41898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6065a6cc-f274-473c-a26c-e631ca41898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc51964-4b17-43c5-ad6c-20c5c49340c0', 'volume_name': 'volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0d1c8-679f-4a32-8c37-de011ef1016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0d1c8-679f-4a32-8c37-de011ef1016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218f65b6-9ec0-4207-98f0-ce3f9c1c86d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:31 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Volume 3dc51964-4b17-43c5-ad6c-20c5c49340c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0', 'volume_size': 1} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47185501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc51964-4b17-43c5-ad6c-20c5c49340c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:31Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Creating volume 3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:31 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:31 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 1073741824 Jul 08 16:37:31 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-81fccf15-6465-4d9d-a003-4a515c755963-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-81fccf15-6465-4d9d-a003-4a515c755963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-81fccf15-6465-4d9d-a003-4a515c755963" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-81fccf15-6465-4d9d-a003-4a515c755963" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Deleting offline snapshot 81fccf15-6465-4d9d-a003-4a515c755963 of volume 942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] snapshot_file for this snap is: volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0006c-f7a5-4d07-ae7d-a3dd1e9e0bb3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:31 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 Jul 08 16:37:31 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:31 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 1073741824" returned: 0 in 0.837s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:31 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:31 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 Jul 08 16:37:31 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:32 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963" returned: 0 in 0.812s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-942657df-2402-4cab-bc57-0877ef263a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce2a8f0-5167-436a-bc5f-2606f92cf305]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:32 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 Jul 08 16:37:32 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:32 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0" returned: 0 in 0.698s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218f65b6-9ec0-4207-98f0-ce3f9c1c86d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ad55e-8ec9-427c-9d00-e315500fa0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:32 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Volume volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 (3dc51964-4b17-43c5-ad6c-20c5c49340c0): created successfully Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ad55e-8ec9-427c-9d00-e315500fa0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:32 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (34baca80-b226-4e59-ba04-e6f6172fbede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:32 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-601731d2-1dee-4305-9dec-2213914897a8 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:37:33 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93" returned: 0 in 0.784s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:33 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 Jul 08 16:37:33 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot a515da5f-2f4b-4a48-ba5e-f491aa489bc0 of volume 3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b79bf4-ffc7-4daa-b13b-dc9981f4578a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:33 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 Jul 08 16:37:33 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:33 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963" returned: 0 in 0.778s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:33 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:33 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963 Jul 08 16:37:33 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:34 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0" returned: 0 in 0.825s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:34 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 1G Jul 08 16:37:34 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:34 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93.81fccf15-6465-4d9d-a003-4a515c755963" returned: 0 in 0.672s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-81fccf15-6465-4d9d-a003-4a515c755963" released by "_delete_snapshot" :: held 3.168s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" released by "delete_snapshot" :: held 3.191s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Created reservations ['45c4b8a6-5c27-4ecc-9d13-b2cecec687c1', '23bdb81e-4d74-497f-87a1-997704ea8029', '9ee42aa2-6f22-4a5e-8e77-852e9bcbedb2', '8332d406-3e38-4d5f-b100-d922333ae590'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:34 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Delete snapshot completed successfully. Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6d30c46a-512e-4292-a47d-88123f7c1379 tempest-ProjectReaderTests-494057707 None] Lock "cinder-81fccf15-6465-4d9d-a003-4a515c755963-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:34 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 1G" returned: 0 in 0.849s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:34 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:35 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 Jul 08 16:37:35 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-942657df-2402-4cab-bc57-0877ef263a93-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "cinder-942657df-2402-4cab-bc57-0877ef263a93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:35 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0" returned: 0 in 0.702s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:35 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 is being set with open permissions: ugo+rw Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Acquiring lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:35 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 Jul 08 16:37:35 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" acquired by "delete_volume" :: waited 0.019s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f06f7-89e7-4b25-ba58-e9428e813008]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:35 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:35 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 Jul 08 16:37:35 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:36 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0" returned: 0 in 0.669s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:36 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info Jul 08 16:37:36 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:36 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93" returned: 0 in 0.778s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:36 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:36 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93 Jul 08 16:37:36 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:37 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info" returned: 0 in 0.666s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:37 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info is being set with open permissions: ugo+rw Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:37 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info Jul 08 16:37:37 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:37 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-942657df-2402-4cab-bc57-0877ef263a93" returned: 0 in 0.675s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "cinder-quobyte-942657df-2402-4cab-bc57-0877ef263a93" released by "delete_volume" :: held 1.520s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Created reservations ['782d67a2-7bee-4357-823c-f087a5c44d67', '4cfa7cbd-0776-40f6-97b3-82f131a8f247', '62cc33bc-0b5e-46cc-a7e6-db11322d70b5', 'b882b852-fd48-4394-b8a9-7eb74de776d3'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:37 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:37 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:37 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.info" returned: 0 in 0.648s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:37 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.447s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:37 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-835334a2-e42e-415a-aeb7-4c613f479bb6 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:37:38 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.688s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:38 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Deleted volume successfully. Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-844cc2f0-7fb5-4449-8a5e-021dfea06495 tempest-ProjectReaderTests-494057707 None] Lock "cinder-942657df-2402-4cab-bc57-0877ef263a93-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-a515da5f-2f4b-4a48-ba5e-f491aa489bc0-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-a515da5f-2f4b-4a48-ba5e-f491aa489bc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-a515da5f-2f4b-4a48-ba5e-f491aa489bc0" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-a515da5f-2f4b-4a48-ba5e-f491aa489bc0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot a515da5f-2f4b-4a48-ba5e-f491aa489bc0 of volume 3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[52651c08-c11c-46f8-b684-9d0083d0ded0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:38 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:38 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 Jul 08 16:37:38 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:39 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0" returned: 0 in 0.875s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:39 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:39 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab72f16-ea3c-4e70-8211-f335dbecdbb8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:39 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:39 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 Jul 08 16:37:39 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:40 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0" returned: 0 in 0.797s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:40 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:40 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 Jul 08 16:37:40 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:41 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0" returned: 0 in 0.760s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:41 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0 Jul 08 16:37:41 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Flow 'volume_create_manager' (c80ccbec-156b-4bef-acd7-59e8cd1c8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efe19c5-fd2c-43ee-9cc6-273e10a38073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efe19c5-fd2c-43ee-9cc6-273e10a38073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366417352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ea182-e9b3-405d-898e-8f2deca0f33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da233eafa7c041f0bc9ee8b5e189fe1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:42Z,use_quota=True,user_id='681fb41496c449fda86a13f4e4ee2882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280f3423-99e7-4233-9c3c-e9c295b1f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280f3423-99e7-4233-9c3c-e9c295b1f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6df47a0-cfe4-4b07-9586-c89524438195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6df47a0-cfe4-4b07-9586-c89524438195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8ea182-e9b3-405d-898e-8f2deca0f33d', 'volume_name': 'volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c910b-5c68-4c30-a5e0-ddcc3743bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c910b-5c68-4c30-a5e0-ddcc3743bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3562456b-b642-4ada-bd31-eb133b49975b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:41 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Volume 5b8ea182-e9b3-405d-898e-8f2deca0f33d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d', 'volume_size': 1} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366417352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ea182-e9b3-405d-898e-8f2deca0f33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da233eafa7c041f0bc9ee8b5e189fe1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:42Z,use_quota=True,user_id='681fb41496c449fda86a13f4e4ee2882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Creating volume 5b8ea182-e9b3-405d-898e-8f2deca0f33d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:41 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:41 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d 1073741824 Jul 08 16:37:41 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:41 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0.a515da5f-2f4b-4a48-ba5e-f491aa489bc0" returned: 0 in 0.691s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-a515da5f-2f4b-4a48-ba5e-f491aa489bc0" released by "_delete_snapshot" :: held 3.227s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" released by "delete_snapshot" :: held 3.248s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Created reservations ['5337a3fe-6da8-44b9-a382-7afa3a1673b6', '6cd1fae1-ec3b-45f3-a1b5-f1b0b4d5e2f2', 'c58d20ae-87a5-40e2-b46b-43763fddc464', '8ccdb8df-8de2-40a9-b952-ccee8fb8d2d7'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:41 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:37:41 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-9e35e565-66a8-4b06-97f6-11c1fb0f6f74 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-a515da5f-2f4b-4a48-ba5e-f491aa489bc0-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:42 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d 1073741824" returned: 0 in 0.811s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:42 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d Jul 08 16:37:42 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-3dc51964-4b17-43c5-ad6c-20c5c49340c0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "cinder-3dc51964-4b17-43c5-ad6c-20c5c49340c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" acquired by "delete_volume" :: waited 0.026s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ef47a-7aed-4c25-9d0b-d8ec8ff35b28]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:42 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:42 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 Jul 08 16:37:42 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:43 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d" returned: 0 in 0.643s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3562456b-b642-4ada-bd31-eb133b49975b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de27f59a-d40c-4e99-8dcf-740ca3d56d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:43 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Volume volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d (5b8ea182-e9b3-405d-898e-8f2deca0f33d): created successfully Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de27f59a-d40c-4e99-8dcf-740ca3d56d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Flow 'volume_create_manager' (c80ccbec-156b-4bef-acd7-59e8cd1c8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:43 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-2770f35f-3a4c-4aa8-9c98-73f268b41551 tempest-ProjectReaderTests-406243321 None] Created volume successfully. Jul 08 16:37:43 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0" returned: 0 in 0.754s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:43 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0 Jul 08 16:37:43 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Acquiring lock "cinder-5b8ea182-e9b3-405d-898e-8f2deca0f33d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "cinder-5b8ea182-e9b3-405d-898e-8f2deca0f33d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Acquiring lock "cinder-quobyte-5b8ea182-e9b3-405d-898e-8f2deca0f33d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "cinder-quobyte-5b8ea182-e9b3-405d-898e-8f2deca0f33d" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483789a-f824-4370-a921-fbe8b1ae8eae]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:43 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:44 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d Jul 08 16:37:44 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:44 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-3dc51964-4b17-43c5-ad6c-20c5c49340c0" returned: 0 in 0.648s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-3dc51964-4b17-43c5-ad6c-20c5c49340c0" released by "delete_volume" :: held 1.469s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Created reservations ['150eebf6-dd87-490a-b8a1-084f80c5a2ba', '922580f9-ae50-4298-bc95-d008895d53d6', '8b62cb29-71ab-4848-befd-e2ef7b5069d5', '4c16610e-ad42-4351-9df0-a0692ed6f180'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:44 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:44 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:44 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d" returned: 0 in 0.761s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:44 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:44 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d Jul 08 16:37:44 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:45 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.638s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:45 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-8545a7c2-4987-4dcb-a27e-9a1f39279ecf tempest-ProjectMemberTests-1193250347 None] Lock "cinder-3dc51964-4b17-43c5-ad6c-20c5c49340c0-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:45 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-5b8ea182-e9b3-405d-898e-8f2deca0f33d" returned: 0 in 0.677s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "cinder-quobyte-5b8ea182-e9b3-405d-898e-8f2deca0f33d" released by "delete_volume" :: held 1.480s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Created reservations ['2d7e3d06-9c13-4f58-83d6-293615749e22', '3daaf9c7-4eef-4295-9e10-e1d11938d44a', 'c621e2b8-a381-4c40-bbb7-d4b444e3b643', 'c3dabce7-5e54-4234-9f0e-ec46ec2d07ff'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (f5c0ee32-d7f0-4aa1-8f51-27a49b1aef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792d66b4-6ba3-4004-86e7-044b92ee820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792d66b4-6ba3-4004-86e7-044b92ee820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666974188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333afbb0-8a0d-49f3-8fda-19472a59f41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:45Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f72621-b3d9-4db0-b738-da751a173211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f72621-b3d9-4db0-b738-da751a173211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7472ea-f85e-4c53-98bc-20f01322b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7472ea-f85e-4c53-98bc-20f01322b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333afbb0-8a0d-49f3-8fda-19472a59f41d', 'volume_name': 'volume-333afbb0-8a0d-49f3-8fda-19472a59f41d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd84f9f-b8a5-4e5e-b67d-e4a47543a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd84f9f-b8a5-4e5e-b67d-e4a47543a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389faad2-20cc-436c-9609-2903e069a7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:45 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Volume 333afbb0-8a0d-49f3-8fda-19472a59f41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333afbb0-8a0d-49f3-8fda-19472a59f41d', 'volume_size': 1} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666974188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333afbb0-8a0d-49f3-8fda-19472a59f41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:45Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Creating volume 333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:45 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:45 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d 1073741824 Jul 08 16:37:45 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:45 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:45 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:45 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:46 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.674s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:46 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Deleted volume successfully. Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-3c4d16b9-79f8-42da-a0af-20e8878f2fae tempest-ProjectReaderTests-406243321 None] Lock "cinder-5b8ea182-e9b3-405d-898e-8f2deca0f33d-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:46 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d 1073741824" returned: 0 in 0.901s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:46 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d Jul 08 16:37:46 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Flow 'volume_create_manager' (96283b2a-4b15-4e2d-80f6-134f414078de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a637d2c4-d6b8-489a-b025-af3d4ef7f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a637d2c4-d6b8-489a-b025-af3d4ef7f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468090301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486e4346-bdbb-42d0-949c-d8ff86dc5ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da233eafa7c041f0bc9ee8b5e189fe1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:47Z,use_quota=True,user_id='681fb41496c449fda86a13f4e4ee2882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49215f6-4343-4e28-ae23-5b719bb3397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49215f6-4343-4e28-ae23-5b719bb3397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9048c7b-17da-4f08-aa7a-99e60f2dc28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9048c7b-17da-4f08-aa7a-99e60f2dc28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486e4346-bdbb-42d0-949c-d8ff86dc5ed4', 'volume_name': 'volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0efe9-d5b4-4a26-9d8a-c895db59cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0efe9-d5b4-4a26-9d8a-c895db59cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc95e429-f3b7-4065-b59d-3f28cf32d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:46 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Volume 486e4346-bdbb-42d0-949c-d8ff86dc5ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4', 'volume_size': 1} Jul 08 16:37:46 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:47 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d" returned: 0 in 0.650s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468090301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486e4346-bdbb-42d0-949c-d8ff86dc5ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da233eafa7c041f0bc9ee8b5e189fe1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:37:47Z,use_quota=True,user_id='681fb41496c449fda86a13f4e4ee2882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Creating volume 486e4346-bdbb-42d0-949c-d8ff86dc5ed4 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:37:47 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389faad2-20cc-436c-9609-2903e069a7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333afbb0-8a0d-49f3-8fda-19472a59f41d', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:47 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 1073741824 Jul 08 16:37:47 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f411d6-1731-4cb3-b623-c2230dd30119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:47 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Volume volume-333afbb0-8a0d-49f3-8fda-19472a59f41d (333afbb0-8a0d-49f3-8fda-19472a59f41d): created successfully Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f411d6-1731-4cb3-b623-c2230dd30119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (f5c0ee32-d7f0-4aa1-8f51-27a49b1aef2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:47 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-e422777c-2c25-4dd4-8547-563e07cbfa30 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:47 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:47 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 1073741824" returned: 0 in 0.829s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:48 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 Jul 08 16:37:48 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:48 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" returned: 0 in 0.649s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.972s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc95e429-f3b7-4065-b59d-3f28cf32d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74f62e1-0cef-462b-a788-b842e686f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 375bb8bc-eddc-495a-93cf-45fd15245403 of volume 333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:37:48 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Volume volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 (486e4346-bdbb-42d0-949c-d8ff86dc5ed4): created successfully Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74f62e1-0cef-462b-a788-b842e686f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Flow 'volume_create_manager' (96283b2a-4b15-4e2d-80f6-134f414078de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[157e1b31-6e31-4168-a93f-cc204e735801]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:48 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:48 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-eae37648-89c8-4779-8506-c7d8b155233f tempest-ProjectReaderTests-406243321 None] Created volume successfully. Jul 08 16:37:48 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d Jul 08 16:37:48 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:49 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d" returned: 0 in 0.767s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:49 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 1G Jul 08 16:37:49 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Acquiring lock "cinder-486e4346-bdbb-42d0-949c-d8ff86dc5ed4-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "cinder-486e4346-bdbb-42d0-949c-d8ff86dc5ed4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Acquiring lock "cinder-quobyte-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "cinder-quobyte-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5f024e-3c80-4eff-a990-e107424f63ad]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:49 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:49 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 Jul 08 16:37:49 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:50 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 1G" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333afbb0-8a0d-49f3-8fda-19472a59f41d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:50 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333afbb0-8a0d-49f3-8fda-19472a59f41d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 Jul 08 16:37:50 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:50 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" returned: 0 in 0.781s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:50 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:50 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4 Jul 08 16:37:50 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:51 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333afbb0-8a0d-49f3-8fda-19472a59f41d -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403" returned: 0 in 0.720s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:51 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 is being set with open permissions: ugo+rw Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:51 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 Jul 08 16:37:51 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:51 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" returned: 0 in 0.701s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "cinder-quobyte-486e4346-bdbb-42d0-949c-d8ff86dc5ed4" released by "delete_volume" :: held 1.526s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Created reservations ['a0f73346-309c-4d19-a0c8-84333b78d22d', 'e9de8360-1caf-45cb-9c36-02b2baddf502', '8112e92e-94ba-4257-b9fb-292bbda84ae4', 'fd5b793f-9b36-4bbd-8ae6-2dd3ba96d426'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:51 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:51 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:51 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403" returned: 0 in 0.671s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:51 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:51 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info Jul 08 16:37:51 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:52 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:52 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:37:52 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Deleted volume successfully. Jul 08 16:37:52 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-d17e206a-3591-4e8c-aafc-ef5b12b54cc4 tempest-ProjectReaderTests-406243321 None] Lock "cinder-486e4346-bdbb-42d0-949c-d8ff86dc5ed4-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:52 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info" returned: 0 in 0.706s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:52 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info is being set with open permissions: ugo+rw Jul 08 16:37:52 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:52 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info Jul 08 16:37:52 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:53 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.info" returned: 0 in 0.689s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:53 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.467s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:53 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-dd76c9f5-117f-440a-a777-e94dea69296f tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:37:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-375bb8bc-eddc-495a-93cf-45fd15245403-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:53 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-375bb8bc-eddc-495a-93cf-45fd15245403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-375bb8bc-eddc-495a-93cf-45fd15245403" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-375bb8bc-eddc-495a-93cf-45fd15245403" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 375bb8bc-eddc-495a-93cf-45fd15245403 of volume 333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b1561-a749-4fed-b12a-4361a8b98a63]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:54 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 Jul 08 16:37:54 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:54 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403" returned: 0 in 0.772s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-333afbb0-8a0d-49f3-8fda-19472a59f41d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ee278-5c28-40a2-b44a-09ce38565b6c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:54 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:54 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d Jul 08 16:37:54 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:55 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:55 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:55 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 Jul 08 16:37:55 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:56 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403" returned: 0 in 0.741s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:56 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:56 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403 Jul 08 16:37:56 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:57 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:57 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d.375bb8bc-eddc-495a-93cf-45fd15245403" returned: 0 in 0.635s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-375bb8bc-eddc-495a-93cf-45fd15245403" released by "_delete_snapshot" :: held 3.013s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" released by "delete_snapshot" :: held 3.037s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:57 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Created reservations ['fa17d56a-6d84-413b-b1a6-3bea1bd97500', 'dedf903f-dc8f-4784-aa05-35f8a8f4da52', '9184f7fd-848c-425f-bac4-eb4779ccfb21', 'ddb206c4-feb1-4cf7-94b1-72ce41ab540e'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:57 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:37:57 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-050e7088-a638-4f0a-8fee-3c3823b76381 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-375bb8bc-eddc-495a-93cf-45fd15245403-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-333afbb0-8a0d-49f3-8fda-19472a59f41d-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-333afbb0-8a0d-49f3-8fda-19472a59f41d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ab6d6-4051-4b6c-8768-b783a4ba85a7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:37:58 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:58 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d Jul 08 16:37:58 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:59 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d" returned: 0 in 0.764s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:59 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d Jul 08 16:37:59 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:37:59 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-333afbb0-8a0d-49f3-8fda-19472a59f41d" returned: 0 in 0.655s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-333afbb0-8a0d-49f3-8fda-19472a59f41d" released by "delete_volume" :: held 1.474s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Created reservations ['581e6e2e-4b3e-4e6b-be6d-942e66652685', '9623d3d6-86dc-452f-8654-0788362d4d5d', '41727e47-015e-41a5-bdfd-d716e016cdff', '4d7e1e4c-1101-44bd-ba08-28f90a8dda8e'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:37:59 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:37:59 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:37:59 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:00 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.654s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:38:00 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-56ac225c-1e8c-4bb1-a976-d84246c7dcd8 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-333afbb0-8a0d-49f3-8fda-19472a59f41d-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (2c43ed70-99fa-41c5-abae-f9f46a26eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435eff25-40b8-4196-8838-b9426fc4c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435eff25-40b8-4196-8838-b9426fc4c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114972752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:38:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b099be9-157d-43bd-b894-0bc8a44945a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b099be9-157d-43bd-b894-0bc8a44945a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36577017-1265-4377-ba69-0dd9a61bd560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36577017-1265-4377-ba69-0dd9a61bd560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0', 'volume_name': 'volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cfc53a-aea4-437b-8057-5b189c85bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cfc53a-aea4-437b-8057-5b189c85bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb45e6f-bfcb-4675-9ba5-64b2770f3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:00 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Volume 9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0', 'volume_size': 1} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114972752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:38:01Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Creating volume 9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:38:00 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:38:00 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:00 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 1073741824 Jul 08 16:38:00 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:01 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 1073741824" returned: 0 in 0.814s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:01 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:01 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 Jul 08 16:38:01 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:02 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" returned: 0 in 0.644s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb45e6f-bfcb-4675-9ba5-64b2770f3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4122a6-5dd9-4ba0-be14-62bbd9f8e191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:02 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Volume volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 (9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0): created successfully Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4122a6-5dd9-4ba0-be14-62bbd9f8e191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:02 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (2c43ed70-99fa-41c5-abae-f9f46a26eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:38:02 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-741e0cea-db44-4fce-9f50-99bfdccca189 tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 7ef1ba4e-7163-47e2-b798-5378cc82090b of volume 9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac8e0d-747c-4906-8096-70fc4261fd22]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:03 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 Jul 08 16:38:03 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:03 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" returned: 0 in 0.765s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:03 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:03 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b 1G Jul 08 16:38:03 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:04 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b 1G" returned: 0 in 0.810s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:04 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:04 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b Jul 08 16:38:04 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:05 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b" returned: 0 in 0.673s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:05 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b is being set with open permissions: ugo+rw Jul 08 16:38:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b Jul 08 16:38:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:05 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:05 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b" returned: 0 in 0.668s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:06 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info Jul 08 16:38:06 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:06 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info" returned: 0 in 0.655s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:06 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info is being set with open permissions: ugo+rw Jul 08 16:38:06 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:06 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info Jul 08 16:38:06 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:07 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.info" returned: 0 in 0.623s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:07 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.281s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:07 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-8dfbf8f2-7ae0-4e91-9839-929baf145603 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-7ef1ba4e-7163-47e2-b798-5378cc82090b-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-7ef1ba4e-7163-47e2-b798-5378cc82090b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-7ef1ba4e-7163-47e2-b798-5378cc82090b" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-7ef1ba4e-7163-47e2-b798-5378cc82090b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 7ef1ba4e-7163-47e2-b798-5378cc82090b of volume 9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f5b4d-9874-427e-ae6d-1eb37164aca9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:08 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:08 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b Jul 08 16:38:08 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:09 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b" returned: 0 in 0.770s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a25a1-21a8-4506-9851-38262837241a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:09 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 Jul 08 16:38:09 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:09 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" returned: 0 in 0.762s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:09 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:09 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b Jul 08 16:38:09 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:10 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b" returned: 0 in 0.736s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:10 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:10 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b Jul 08 16:38:10 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:11 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:11 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0.7ef1ba4e-7163-47e2-b798-5378cc82090b" returned: 0 in 0.657s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-7ef1ba4e-7163-47e2-b798-5378cc82090b" released by "_delete_snapshot" :: held 3.021s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" released by "delete_snapshot" :: held 3.045s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:11 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Created reservations ['b9334178-ff62-437c-9a67-ba38125197a5', 'e0d843b1-f568-4c95-9ff8-82bd471fa6ad', '1fb2dab2-1097-4443-9c41-24e65427613d', '4ca07426-0afd-4b81-a823-d793c2b2a67b'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:38:11 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:38:11 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-6460a405-17e2-4cb6-ae22-dc3fd2c7f314 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-7ef1ba4e-7163-47e2-b798-5378cc82090b-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" acquired by "delete_volume" :: waited 0.013s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf0f25-220a-40db-92a4-798d437c1950]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:12 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:12 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 Jul 08 16:38:12 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:13 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" returned: 0 in 0.757s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:13 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0 Jul 08 16:38:13 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:13 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:13 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" returned: 0 in 0.647s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0" released by "delete_volume" :: held 1.463s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Created reservations ['5bdf54cf-2953-4e4e-acd9-bd170b7f9677', '9ca4c8cb-789e-4eda-aa96-468472f36616', '6e01af85-d4f7-4acb-bd1e-bbd676d3e8e4', '76c70fd4-32ee-4e04-a993-bc77cb583768'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:14 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:38:14 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:14 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.673s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:38:14 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:38:14 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-4a5be0a2-7d34-4f06-a0b7-54f43378ec84 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-9b50f03f-39f6-43c8-9e34-7d8e8e6bf4d0-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87227) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (3914db4c-241e-4a5b-a49f-3df2f504a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81832e5d-e48b-4a8f-8f25-d95c510feedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81832e5d-e48b-4a8f-8f25-d95c510feedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512732919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07146c27-4541-4004-aee3-3cc260123bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:38:15Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e218bdbd-90b1-4988-9c37-5e79604f3a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e218bdbd-90b1-4988-9c37-5e79604f3a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0e6ddb-05b8-4904-b9ea-044b26ec1935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0e6ddb-05b8-4904-b9ea-044b26ec1935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07146c27-4541-4004-aee3-3cc260123bad', 'volume_name': 'volume-07146c27-4541-4004-aee3-3cc260123bad', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2da9f17-8bd3-4206-8d37-997c22264257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2da9f17-8bd3-4206-8d37-997c22264257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf1bc4-addd-416a-8ba6-6eb7a745d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:15 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Volume 07146c27-4541-4004-aee3-3cc260123bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07146c27-4541-4004-aee3-3cc260123bad', 'volume_size': 1} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512732919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07146c27-4541-4004-aee3-3cc260123bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459be77fca394246bd3b8ab644aa4ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T14:38:15Z,use_quota=True,user_id='8165fb9759e6465c90ae3c213b1d947a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9151a757-b842-4ee0-86ac-8a19502d62be),volume_type_id=9151a757-b842-4ee0-86ac-8a19502d62be)}" {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Creating volume 07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Selected osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 as target Quobyte volume. {{(pid=87227) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 16:38:15 devstack cinder-volume[87227]: INFO cinder.volume.drivers.remotefs [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] casted to osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63 Jul 08 16:38:15 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad 1073741824 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:15 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad 1073741824 Jul 08 16:38:15 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:16 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad 1073741824" returned: 0 in 0.798s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:16 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad Jul 08 16:38:16 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:16 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad" returned: 0 in 0.646s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'} {{(pid=87227) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf1bc4-addd-416a-8ba6-6eb7a745d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07146c27-4541-4004-aee3-3cc260123bad', 'volume_size': 1}' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5a24c8-e653-423e-b2c0-2b3fd5dc85ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 16:38:16 devstack cinder-volume[87227]: INFO cinder.volume.flows.manager.create_volume [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Volume volume-07146c27-4541-4004-aee3-3cc260123bad (07146c27-4541-4004-aee3-3cc260123bad): created successfully Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5a24c8-e653-423e-b2c0-2b3fd5dc85ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87227) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 16:38:16 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Flow 'volume_create_manager' (3914db4c-241e-4a5b-a49f-3df2f504a52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87227) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 16:38:16 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-a8878dcc-4c2c-4f9a-9910-c980c30b5dbd tempest-ProjectMemberTests-1193250347 None] Created volume successfully. Jul 08 16:38:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:17 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Creating offline snapshot 20fec418-1a81-4f8d-8126-365b9964a860 of volume 07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 16:38:17 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4d7bc-ca35-40f7-a9f0-be3529a9e2c7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:17 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:17 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad Jul 08 16:38:17 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:18 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad" returned: 0 in 0.761s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 1G {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:18 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 1G Jul 08 16:38:18 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:18 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 1G" returned: 0 in 0.788s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:18 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07146c27-4541-4004-aee3-3cc260123bad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:18 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07146c27-4541-4004-aee3-3cc260123bad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 Jul 08 16:38:18 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:19 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:38:19 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:19 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07146c27-4541-4004-aee3-3cc260123bad -F qcow2 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860" returned: 0 in 0.668s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:19 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 is being set with open permissions: ugo+rw Jul 08 16:38:19 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:19 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 Jul 08 16:38:19 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:20 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.641s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_service.periodic_task [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] Running periodic task VolumeManager._thread_info {{(pid=87227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread count: 28 {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG cinder.volume.manager [None req-adc58f98-f3b9-4ea2-9e9e-6227d603d50d None None] thread info: [<_MainThread(MainThread, started 126543272124544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 16:38:20 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860" returned: 0 in 0.669s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:20 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info Jul 08 16:38:20 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:20 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info" returned: 0 in 0.682s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:20 devstack cinder-volume[87227]: WARNING cinder.volume.drivers.remotefs [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info is being set with open permissions: ugo+rw Jul 08 16:38:20 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:20 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info Jul 08 16:38:20 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:21 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.info" returned: 0 in 0.655s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:21 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.299s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:21 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-d337dbce-a679-41ac-9194-aa000e939382 tempest-ProjectMemberTests-1193250347 None] Create snapshot completed successfully Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-20fec418-1a81-4f8d-8126-365b9964a860-delete_snapshot" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-20fec418-1a81-4f8d-8126-365b9964a860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" by "delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-20fec418-1a81-4f8d-8126-365b9964a860" by "_delete_snapshot" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-20fec418-1a81-4f8d-8126-365b9964a860" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Deleting offline snapshot 20fec418-1a81-4f8d-8126-365b9964a860 of volume 07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] snapshot_file for this snap is: volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc9af8-f0cb-41b2-9086-3d374601a7e4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:22 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:22 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 Jul 08 16:38:22 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:23 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860" returned: 0 in 0.776s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:23 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.remotefs [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07146c27-4541-4004-aee3-3cc260123bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87227) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 16:38:23 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f49995-760b-45d3-8e9e-d7a88ba575d6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:23 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:23 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad Jul 08 16:38:23 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:24 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad" returned: 0 in 0.758s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:24 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:24 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 Jul 08 16:38:24 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:25 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860" returned: 0 in 0.729s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:25 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860 Jul 08 16:38:25 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:25 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad.20fec418-1a81-4f8d-8126-365b9964a860" returned: 0 in 0.649s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-20fec418-1a81-4f8d-8126-365b9964a860" released by "_delete_snapshot" :: held 3.002s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" released by "delete_snapshot" :: held 3.024s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Created reservations ['51b700f0-9244-4592-940e-ea28d44b4a42', 'ec4cb813-5279-496f-aafb-a0605d39aae2', 'c3707b9d-0272-44db-a47a-07cc45b1c5f1', '0d00285b-229d-4252-9826-49b5ba0c20d6'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:38:25 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Delete snapshot completed successfully. Jul 08 16:38:25 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-df411ff7-c422-449b-8993-e29bae2c5d0a tempest-ProjectMemberTests-1193250347 None] Lock "cinder-20fec418-1a81-4f8d-8126-365b9964a860-delete_snapshot" released by "delete_snapshot" :: held 3.161s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-07146c27-4541-4004-aee3-3cc260123bad-delete_volume" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-07146c27-4541-4004-aee3-3cc260123bad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" by "delete_volume" {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" acquired by "delete_volume" :: waited 0.015s {{(pid=87227) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a7882-c54b-44ac-bd43-6d86c74939ad]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 16:38:26 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:27 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad Jul 08 16:38:27 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:27 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad" returned: 0 in 0.739s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:27 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:27 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad Jul 08 16:38:27 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:28 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c/volume-07146c27-4541-4004-aee3-3cc260123bad" returned: 0 in 0.667s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-quobyte-07146c27-4541-4004-aee3-3cc260123bad" released by "delete_volume" :: held 1.462s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG cinder.quota [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Created reservations ['e53d0af5-ce23-48dd-b669-b7c1ff9a53a5', 'f2578721-bc98-4b7f-a960-ee80221fcb9c', 'f9de3cba-55f6-4bdc-a829-c8f03685db33', '5441fd5b-b9de-4b21-9e4f-575235f89232'] {{(pid=87227) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63': None} {{(pid=87227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG cinder.volume.drivers.quobyte [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84f5ff03-d8f0-4295-b48a-44e0716aea63'] {{(pid=87227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.lockutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 16:38:28 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 16:38:28 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c Jul 08 16:38:28 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 16:38:29 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 08 16:38:29 devstack cinder-volume[87227]: DEBUG oslo_concurrency.processutils [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb18c281062cc9f0f36d64fe3ff6727c" returned: 0 in 0.647s {{(pid=87227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 16:38:29 devstack cinder-volume[87227]: DEBUG cinder.manager [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Notifying Schedulers of capabilities ... {{(pid=87227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 16:38:29 devstack cinder-volume[87227]: INFO cinder.volume.manager [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Deleted volume successfully. Jul 08 16:38:29 devstack cinder-volume[87227]: DEBUG cinder.coordination [None req-51c7f50d-2187-4418-b83b-c3881d120427 tempest-ProjectMemberTests-1193250347 None] Lock "cinder-07146c27-4541-4004-aee3-3cc260123bad-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87227) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 16:38:38 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:INSERT=32,cinder:UPDATE=108,cinder:SELECT=80,cinder:DELETE=13 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 16:38:39 devstack cinder-volume[87227]: DEBUG dbcounter [-] [87227] Writing DB stats cinder:UPDATE=114,cinder:SELECT=82,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}